-- Logs begin at Thu 2022-08-18 11:21:28 UTC, end at Thu 2022-08-18 12:41:33 UTC. -- Aug 18 12:11:38.535618 dv-cinder-836027-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 12:11:38.544522 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 12:11:38.546504 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 12:11:38 2022] *** Aug 18 12:11:38.546504 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 12:11:38.546504 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 12:11:38.546504 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: nodename: dv-cinder-836027-7-iscsi Aug 18 12:11:38.546504 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: machine: x86_64 Aug 18 12:11:38.546504 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: clock source: unix Aug 18 12:11:38.546504 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: pcre jit disabled Aug 18 12:11:38.546504 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: detected number of CPU cores: 4 Aug 18 12:11:38.546504 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: current working directory: / Aug 18 12:11:38.546504 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: detected binary path: /usr/bin/uwsgi-core Aug 18 12:11:38.547187 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: your processes number limit is 47680 Aug 18 12:11:38.547187 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: your memory page size is 4096 bytes Aug 18 12:11:38.547187 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: detected max file descriptor number: 2048 Aug 18 12:11:38.547187 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: lock engine: pthread robust mutexes Aug 18 12:11:38.547187 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: thunder lock: enabled Aug 18 12:11:38.547187 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 12:11:38.547187 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 12:11:38.586347 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: Python main interpreter initialized at 0x55c76f1819c0 Aug 18 12:11:38.586347 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: python threads support enabled Aug 18 12:11:38.586347 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: your server socket listen backlog is limited to 100 connections Aug 18 12:11:38.586347 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: your mercy for graceful operations on workers is 90 seconds Aug 18 12:11:38.586723 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 12:11:38.586803 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: *** Operational MODE: preforking *** Aug 18 12:11:38.587019 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: *** uWSGI is running in multiple interpreter mode *** Aug 18 12:11:38.587019 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: spawned uWSGI master process (pid: 106114) Aug 18 12:11:38.587222 dv-cinder-836027-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 12:11:38.587802 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: spawned uWSGI worker 1 (pid: 106115, cores: 1) Aug 18 12:11:38.591453 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: spawned uWSGI worker 2 (pid: 106116, cores: 1) Aug 18 12:11:38.591453 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 12:11:39.262074 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 12:11:39.262679 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 12:11:40.361124 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 12:11:40.361124 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: from cryptography.utils import int_from_bytes Aug 18 12:11:40.361826 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 12:11:40.361826 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: from cryptography.utils import int_from_bytes Aug 18 12:11:40.367362 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 12:11:40.367362 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: from cryptography.utils import int_from_bytes Aug 18 12:11:40.367808 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 12:11:40.367808 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: from cryptography.utils import int_from_bytes Aug 18 12:11:42.866073 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 12:11:42.866969 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 12:11:42.866969 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 12:11:42.867441 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 12:11:42.867542 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 12:11:42.867641 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 12:11:42.867724 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 12:11:42.867804 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 12:11:42.867894 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 12:11:42.867989 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 12:11:42.868071 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.868151 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.868231 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.868333 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.868484 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.868573 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.868809 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.868907 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.869142 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.869237 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.869456 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.869554 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.869781 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.869874 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.870102 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.870191 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.870433 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.870532 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.870695 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.870780 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.871014 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.871105 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.871344 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-7-iscsi {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.871451 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-7-iscsi {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.871696 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.871789 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.872005 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.872089 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.872317 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.872403 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.872638 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.872724 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.872944 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.873029 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.873268 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.873360 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.873575 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.873666 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.874074 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.874185 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.874518 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.874633 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.874826 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.874974 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.875712 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.875834 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.876060 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.876190 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.876400 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.876592 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.876775 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.876956 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.877152 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.877302 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.877393 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.877519 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.877612 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.877681 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.877911 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.877988 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.878316 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-7-iscsi {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.878439 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-7-iscsi {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.878644 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.878802 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.878947 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.879044 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.879262 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.879347 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.879706 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.879878 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.880021 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.880157 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.880333 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.880431 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.880655 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.880738 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.880985 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.881071 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.881297 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.881437 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.881633 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.881727 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.881978 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.882069 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.882274 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.882373 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.882594 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.882681 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.882900 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.883028 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.883210 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.883303 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.883543 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.883632 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.883865 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.883951 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.884174 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.884261 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.884476 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.884561 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.885001 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.885111 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.885111 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.885275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.885383 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.885462 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.885656 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.885743 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.885981 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.886071 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.886234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.886321 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.886486 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.886582 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.886805 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.886893 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.887128 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.887224 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.887455 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.887557 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.887770 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.887863 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.888077 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.888164 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.888388 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.888480 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.888692 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.888784 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.889002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.889090 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.889321 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.889426 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.889617 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.889712 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.889935 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.890022 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.890254 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.890340 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.890604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.890699 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.890917 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.891010 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.891237 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.891333 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.891662 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.891750 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.891918 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.892013 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.892228 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.892313 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.892567 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.892652 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.892889 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.892983 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.893201 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.893288 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.893523 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.893615 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.893849 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.893944 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.894158 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.894244 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.894467 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.894563 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.894776 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.894862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.895097 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.895192 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.895464 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.895554 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.895764 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.895851 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.896015 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.896100 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.896321 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.896414 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.896627 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.896717 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.896948 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.897034 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.897258 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.897344 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.897568 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.897664 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.897876 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.897971 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.898179 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.898277 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.898485 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.898571 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.898793 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.898877 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.899101 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.899197 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.899420 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.899521 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.899742 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.899828 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.900047 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.900150 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.900355 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.900447 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.900663 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.900749 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.900967 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.901062 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.901288 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.901374 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.901610 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.901696 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.901920 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.902016 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.902226 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.902347 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.902538 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.902643 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.902848 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.902953 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.903171 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.903259 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.903504 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.903606 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.903816 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.903915 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.904141 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.904239 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.904448 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.904534 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.904755 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.904850 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.905074 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.905159 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.905383 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.905470 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.905691 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.905786 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.906013 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.906601 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.906841 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.906930 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.907149 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.907246 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.907491 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.907590 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.907808 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.907894 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.908115 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.908202 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.908421 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.908506 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.908726 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.908821 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.909033 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.909125 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.909338 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.909424 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.909645 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.909737 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.909950 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.910044 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.910252 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.910338 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.910574 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.910671 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.911152 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.911240 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.911489 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.911591 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.911805 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.911900 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.912115 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.912201 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.912440 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.912527 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:11:42.912780 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.912878 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.913117 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.913203 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.913460 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.913545 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.913777 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.913871 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.914111 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.914198 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.914447 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.914532 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.914767 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.914853 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.915085 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.915170 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.915399 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.915549 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.915754 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.915843 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.916067 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.916153 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.916380 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.916480 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.916692 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.916778 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.917009 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.917105 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.917331 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.917504 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.917662 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.917756 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.917981 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.918067 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.918297 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.918384 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.918618 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.918706 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.918929 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.919016 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.919246 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.919340 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.919604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.919703 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.919930 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.920023 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.920241 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.920335 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.920587 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.920672 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.920934 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.921019 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.921249 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.921347 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.921574 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.921668 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.921955 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.922566 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.922771 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.922867 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.923084 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.923170 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.923395 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.923551 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.923742 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.923830 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.924074 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.924168 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.924389 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.924475 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.924707 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.924802 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.925022 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.925108 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.925335 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.925432 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.925647 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.925742 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.925960 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.926045 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.926271 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.926357 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.926608 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.926696 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.926926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.927012 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.927243 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.927337 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.927583 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.927672 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.927906 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.927995 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.928221 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.928316 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.928535 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.928622 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.928848 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.928942 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.929152 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.929250 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.929459 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.929548 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.929762 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.929855 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.930070 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.930166 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.930374 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.930467 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.930699 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.930785 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.931027 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.931131 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.931336 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.931440 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.931696 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.931784 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.932006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.932101 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.932317 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.932403 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.932632 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.932719 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.932946 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.933033 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.933251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.933343 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.933565 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.933660 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.933875 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.933962 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.934183 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.934268 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.934509 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.934596 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.934822 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.934909 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.935127 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.935213 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.935475 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.935583 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.935790 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.935887 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.936093 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.936180 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.936409 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.936504 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.936729 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.936816 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.937033 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.937173 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.937356 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.937943 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.938175 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.938271 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.938501 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.938595 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.938815 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.938903 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.939129 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.939215 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.939492 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.939581 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.939830 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.939918 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.940138 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.940223 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.940465 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.940552 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.940791 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.940878 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.941109 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.941202 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.941416 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.941502 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.941728 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.941827 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.942040 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.942126 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.942344 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.942429 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.942652 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.942740 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.942962 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.943048 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.943266 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.943367 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.943645 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.943738 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.943906 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.943993 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.944213 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.944307 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.944518 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.944603 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.944840 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.944925 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.945151 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.945245 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.945459 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.945553 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.945765 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.945858 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.946069 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.946167 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.946414 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.946500 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.946724 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.946810 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.947068 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.947155 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.947403 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.947512 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.947753 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.947842 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.948081 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.948169 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.948397 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.948493 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.948718 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.948804 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.949032 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.949119 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.949348 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.949443 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.949662 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.949748 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.949977 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.950064 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.950302 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.950444 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.950618 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.950717 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.950937 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.951031 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.951253 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.951340 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.951609 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.951711 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.951927 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.952015 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.952251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.952339 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.952564 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.952665 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.952884 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.952971 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.953767 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.953861 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.954106 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.954207 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.954427 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.954520 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.954755 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.954842 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.955069 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.955173 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.955388 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.955546 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.955727 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.955841 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.956044 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.956158 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.957229 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.957334 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.957417 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.957417 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.957417 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.957630 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.957716 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.957821 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.957915 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.958145 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.958242 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.958477 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.958564 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.958799 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.958885 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.959104 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.959198 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.959481 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.959574 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.959780 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.959869 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.960090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.960184 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.960413 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.960502 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.960724 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.960809 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.961050 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.961146 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.961378 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.961478 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.961682 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.961770 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.962005 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.962094 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.962317 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.962404 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.962625 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.962711 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.962939 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.963028 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.963255 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.963349 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.963594 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.963698 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.963906 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.963992 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.964216 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.964340 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.964527 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.964630 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.964838 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.964925 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.965146 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.965232 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.965450 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.965550 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.965767 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.965856 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.966074 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.966161 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.966386 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.966482 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.966704 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.966792 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.967029 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.967159 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.967341 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.967486 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.967678 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.967768 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.968005 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.968090 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.968316 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.968405 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.968645 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.968735 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.968957 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.969045 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.969268 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.969356 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.969576 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.969663 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.969886 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.969976 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.970199 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.970288 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.970517 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.970600 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.970844 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.970921 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.971149 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.971226 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.971488 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.971589 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.971812 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.971980 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.972123 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.972217 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.972443 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.972531 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.972758 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.972853 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.973069 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.973157 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.973381 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.973468 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.973697 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.973794 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.974006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.974092 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.974318 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.974403 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.974628 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.974723 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.974944 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.975033 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.975257 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.975342 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.975605 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.975694 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.975913 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.976038 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.976226 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.976313 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.976542 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.976631 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.976851 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.977125 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.977213 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.977466 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.977562 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.977791 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.978036 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.978131 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.978375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.978463 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.978697 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.978786 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.979023 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.979111 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.979351 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.979471 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.979702 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.979791 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.980026 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.980123 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.980347 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.980435 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.980659 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.980755 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.980971 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.981069 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.981289 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.981375 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.981599 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.981686 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.981907 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.981995 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.982214 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.982301 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.982522 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.982621 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.982827 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.982920 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.983137 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.983223 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.983461 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.983565 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.983772 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.983859 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.984081 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.984170 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.984414 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.984511 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.984721 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.984809 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.985025 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.985113 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.985338 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.985433 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.985654 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.985741 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.985960 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.986053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.986266 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.986362 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.986575 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.986675 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.986881 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.986968 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.987193 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.987282 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.987543 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.987635 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.987896 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.987984 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.988208 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.988297 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.988551 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.988640 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.988886 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.988988 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.989211 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.989298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.989522 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.989616 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.989828 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.989923 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.990133 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.990219 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.990448 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.990543 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.990753 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.990853 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.991055 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.991141 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.991365 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.991507 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.991702 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.991803 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.992009 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.992096 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.992320 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.992406 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.992628 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.992717 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.992940 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.993050 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.993247 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.993337 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.993552 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.993647 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.993863 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.993950 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.994168 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.994253 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.994473 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.994560 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.994787 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.994888 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.995094 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.995180 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.995397 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.995503 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.995732 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.995865 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.996041 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.996209 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.996346 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.996433 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.996653 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.996739 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.996957 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.997053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.997260 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.997356 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.997571 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.997658 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.997879 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.997974 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.998185 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.998279 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.998501 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.998633 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.998813 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.998909 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.999119 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.999206 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.999456 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.999546 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:42.999756 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.000423 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.000598 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.000687 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.000906 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.000994 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.001218 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.001315 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.001528 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.001616 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.001846 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.001998 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.002154 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.002242 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.002470 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.002565 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.002776 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.002878 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.003083 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.003187 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.003389 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.003504 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.003725 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.003831 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.004033 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.004122 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.004368 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.004460 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.004644 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.004757 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.004951 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.005041 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.005253 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.005348 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.005558 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.005654 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.005867 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.005955 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.006172 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.006267 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.006481 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.006585 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.006789 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.006885 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.007094 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.007180 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.007406 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.007519 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.007735 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.007830 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.008087 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.008174 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.008399 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.008495 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.008723 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.008816 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.009042 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.009130 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.009362 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.009451 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.009684 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.009779 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.009995 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.010082 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.010309 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.010397 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.010625 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.010710 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.010933 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.011025 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.011240 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.011336 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.011576 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.011668 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.011896 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.011995 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.012209 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.012303 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.012521 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.012614 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.012843 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.012939 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.013165 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.013252 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.013482 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.013570 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.013788 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.013887 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.014104 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.014192 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.014419 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.014514 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.014734 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.014831 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.015044 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.015131 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.015354 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.015505 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.016233 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.016330 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.016548 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.016635 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.016864 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.016951 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.017179 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.017271 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.017493 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.017579 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.017800 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.017894 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.018115 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.018203 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.018424 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.018517 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.018734 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.018870 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.019052 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.019148 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.019364 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.019479 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.019701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.019798 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.020012 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.020101 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.020324 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.020412 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.020632 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.020728 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.020937 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.021024 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.021245 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.021379 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.021563 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.021702 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.021874 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.022027 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.022312 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.022400 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.022631 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.022732 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.022945 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.023040 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.023261 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.023347 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.023603 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.023694 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.023912 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.024000 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.024231 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.024319 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.024553 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.024641 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.024864 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.024952 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.025241 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.025328 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.025553 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.025642 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.025863 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.025951 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.026181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.026278 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.026500 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.026595 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.026809 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.026896 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.027121 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.027217 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.027451 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.027563 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.027772 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.027863 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.028083 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.028178 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.028391 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.028477 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.028721 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.028808 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.029035 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.029141 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.029363 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.029452 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.029787 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.029875 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.030107 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.030207 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.030419 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.030505 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.030749 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.030836 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.031134 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.031232 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.031446 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.031536 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.031768 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.031863 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.032088 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.032177 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.032404 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.032501 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.032735 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.032824 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.033053 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.033139 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.033367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.033463 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.033688 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.033777 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.033999 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.034096 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.034319 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.034407 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.034641 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.034737 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.034954 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.035041 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.035278 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.035373 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.035630 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.035989 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.036205 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.036306 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.036536 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.036626 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.036935 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.037022 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.037271 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.037433 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.037579 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.037666 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.037890 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.037986 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.038206 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.038304 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.038516 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.038652 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.038823 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.038910 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.039140 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.039245 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.039469 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.039561 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.039782 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.039869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.040094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.040182 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.040407 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.040495 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.040718 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.040807 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.041029 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.041127 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.041339 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.041425 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.041649 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.041737 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.041960 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.042050 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.042286 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.042373 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.042592 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.042686 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.042923 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.043012 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.043233 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.043320 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.043593 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.043700 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.043913 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.044010 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.044222 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.044309 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.044529 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.044624 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.044840 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.044928 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.045150 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.045237 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.045462 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.045567 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.045773 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.045870 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.046121 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.046209 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.046429 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.046524 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.046784 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.046878 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.047119 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.047206 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.047469 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.047573 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.047786 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.047873 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.048106 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.048193 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.048438 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.048529 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.048748 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.048836 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.049378 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.049492 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.049584 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.049674 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.049755 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.049936 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.050030 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.050111 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.050249 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.050340 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.050646 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.050737 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.050828 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.051028 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.051117 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.051205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.051447 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.051551 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.051761 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.051859 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.052072 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.052161 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.052380 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.052468 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.052690 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.052786 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.052999 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.053093 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.053309 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.053403 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.053616 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.053716 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.053924 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.054011 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.054233 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.054331 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.054541 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.054634 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.054869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.054957 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.055182 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.055269 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.055527 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.055619 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.055849 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.055949 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.056169 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.056258 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.056488 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.056585 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.056805 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.056893 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.057122 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.057209 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.057439 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.057526 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.057751 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.057845 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.058069 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.058164 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.058384 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.058479 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.058697 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.058785 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.059017 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.059238 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.059328 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.059602 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.059695 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.059927 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.060196 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.060293 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.060533 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.060636 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.060855 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.060952 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.061169 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.061269 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.061484 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.061572 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.061803 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.061890 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.062120 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.062219 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.062964 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.063055 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.063288 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.063375 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.063632 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.063723 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.063951 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.064040 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.064287 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.064376 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.064616 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.064712 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.064938 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.065026 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.065260 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.065357 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.065581 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.065669 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.065898 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.065994 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.066222 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.066324 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.066545 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.066633 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.066860 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.066947 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.067185 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.067328 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.067530 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.067633 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.067851 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.067939 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.068165 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.068261 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.068483 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.068578 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.068798 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.068893 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.069111 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.069197 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.069421 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.069514 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.069736 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.069833 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.070049 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.070147 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.070362 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.070457 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.070681 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.070778 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.070997 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.071089 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.071319 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.071406 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.071680 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.071770 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.072003 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.072092 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.072317 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.072543 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.072645 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.072868 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.072956 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.073211 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.073460 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.073549 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.073779 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.073868 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.074121 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.074215 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.074454 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.074551 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.074785 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.074881 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.075098 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.075184 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.075423 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.075528 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.075753 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.075842 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.076061 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.076147 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.076369 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.076465 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.076684 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.076780 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.077001 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.077089 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.077309 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.077404 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.077634 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.077721 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.077965 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.078569 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.078798 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.079023 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.079120 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.079381 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.079491 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.079745 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.079975 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.080065 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.080329 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.080418 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.080654 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.080741 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.080989 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.081085 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.081316 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.081402 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.081628 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.081724 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.081938 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.082035 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.082262 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.082348 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.082570 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.082656 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.082877 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.082966 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.083187 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.083275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.083528 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.083633 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.083839 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.083926 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.084144 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.084231 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.084457 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.084553 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.084762 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.084849 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.085069 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.085158 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.085386 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.085487 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.085690 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.085826 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.086001 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.086090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.086315 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.086415 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.086622 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.086716 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.086927 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.087026 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.087232 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.087332 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.087581 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.087671 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.087890 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.087978 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.088197 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.088293 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.088500 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.088587 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.088804 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.088890 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.089110 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.089197 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.089417 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.089551 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.089722 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.089810 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.090027 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.090115 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.090333 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.090420 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.090646 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.090746 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.090955 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.091043 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.091281 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.091378 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.091614 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.091717 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.091949 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.092036 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.092272 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.092407 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.092584 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.092684 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.092921 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.093009 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.093238 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.093325 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.093660 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.093806 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.093925 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.094148 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.094236 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.094477 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.094768 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.094858 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.095107 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.095196 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.095459 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.095573 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.095793 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.095884 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.096089 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.096171 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.096415 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.096511 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.096727 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.096816 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.097037 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.097125 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.097348 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.097517 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.097665 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.097754 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.097975 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.098062 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.098288 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.098383 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.098598 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.098685 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.098909 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.098996 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.099220 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.099315 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.099555 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.099645 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.099870 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.099968 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.100180 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.100275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.100488 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.100575 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.100798 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.100891 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.101108 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.101196 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.101422 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.101511 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.101735 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.101823 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.102054 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.102151 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.102378 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.102522 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.102700 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.102796 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.103016 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.103105 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.103329 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.103447 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.103670 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.103774 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.103983 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.104074 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.104299 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.104387 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.104614 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.104710 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.104927 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.105016 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.105235 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.105321 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.105574 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.105675 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.105892 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.105981 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.106203 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.106291 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.106578 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.106673 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.106895 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.106990 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.107222 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.107310 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.107574 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.107667 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.107889 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.107976 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.108212 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.108299 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.108528 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.108618 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.108842 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.108928 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.109182 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.109285 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.109506 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.109594 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.109841 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.109936 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.110155 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.110251 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.110466 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.110555 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.110775 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.110862 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.111089 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.111185 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.111404 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.111520 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.111733 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.111823 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.112038 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.112181 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.112353 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.112442 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.112669 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.112768 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.112974 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.113062 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.113278 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.113372 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.113587 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.113675 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.113890 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.113978 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.114198 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.114284 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.114502 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.114596 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.114805 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.114893 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.115112 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.115200 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.115439 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.115545 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.115742 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.115830 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.116045 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.116132 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.116349 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.116445 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.116653 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.116740 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.116956 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.117043 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.117260 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.117360 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.117566 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.117655 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.117867 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.117953 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.118170 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.118270 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.118480 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.118569 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.118787 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.118875 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.119123 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.119212 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.119458 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.119549 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.119788 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.119874 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.120099 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.120187 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.120415 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.120506 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.120737 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.120825 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.121048 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.121136 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.121359 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.121446 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.121687 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.121774 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.121999 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.122094 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.122312 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.122399 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.122624 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.122724 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.123028 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.123250 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.123344 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.123587 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.123688 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.123902 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.123998 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.124215 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.124312 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.124530 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.124626 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.125374 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.125515 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.125699 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.125786 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.126010 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.126099 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.126331 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.126455 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.126649 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.126739 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.126971 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.127067 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.127288 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.127383 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.127631 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.127734 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.127944 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.128032 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.128263 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.128351 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.128575 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.128675 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.128892 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.128980 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.129205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.129292 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.129517 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.129613 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.129835 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.129923 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.130150 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.130244 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.130468 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.130564 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.130789 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.130877 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.131102 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.131197 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.131445 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.131538 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.131781 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.131883 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.132095 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.132190 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.132435 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.132524 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.132768 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.132856 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.133101 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.133195 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.133420 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.133509 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.133738 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.133827 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.134049 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.134136 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.134299 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 12:11:43.134389 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.134688 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.135001 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:11:43.135251 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 12:11:43.287568 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO dbcounter [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Registered counter for database nova_api Aug 18 12:11:43.288963 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO dbcounter [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Registered counter for database nova_api Aug 18 12:11:43.314750 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG oslo_db.sqlalchemy.engines [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106116) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:11:43.315105 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_db.sqlalchemy.engines [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106115) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:11:43.322125 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writer thread running {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:11:43.323912 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG dbcounter [-] [106116] Writer thread running {{(pid=106116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:11:43.379927 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.context [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aac207c6-8c23-44cd-8489-7302b48d46d6(cell1) {{(pid=106115) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 12:11:43.382374 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.context [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aac207c6-8c23-44cd-8489-7302b48d46d6(cell1) {{(pid=106116) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 12:11:43.383895 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:43.384377 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:43.386137 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:43.386613 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG oslo_concurrency.lockutils [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106116) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:43.387081 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:43.387516 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG oslo_concurrency.lockutils [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106116) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:43.387648 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:43.389521 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG oslo_concurrency.lockutils [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106116) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:43.389643 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:43.391085 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG oslo_concurrency.lockutils [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106116) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:43.391751 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG oslo_concurrency.lockutils [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106116) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:43.392139 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO dbcounter [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Registered counter for database nova_cell0 Aug 18 12:11:43.394238 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG oslo_concurrency.lockutils [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106116) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:43.396595 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO dbcounter [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Registered counter for database nova_cell0 Aug 18 12:11:43.397885 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO dbcounter [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Registered counter for database nova_cell1 Aug 18 12:11:43.403328 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO dbcounter [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Registered counter for database nova_cell1 Aug 18 12:11:43.405432 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_db.sqlalchemy.engines [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106115) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:11:43.411391 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_db.sqlalchemy.engines [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106115) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:11:43.412740 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG oslo_db.sqlalchemy.engines [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106116) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:11:43.415486 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG oslo_db.sqlalchemy.engines [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106116) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:11:43.420045 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG dbcounter [-] [106116] Writer thread running {{(pid=106116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:11:43.421709 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writer thread running {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:11:43.424025 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writer thread running {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:11:43.426652 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG dbcounter [-] [106116] Writer thread running {{(pid=106116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:11:43.570049 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO dbcounter [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Registered counter for database nova_cell0 Aug 18 12:11:43.572416 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO dbcounter [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Registered counter for database nova_cell0 Aug 18 12:11:43.579727 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_db.sqlalchemy.engines [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106115) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:11:43.583186 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG oslo_db.sqlalchemy.engines [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106116) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:11:43.584926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writer thread running {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:11:43.587697 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG dbcounter [-] [106116] Writer thread running {{(pid=106116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:11:44.000718 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: WARNING keystonemiddleware.auth_token [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 12:11:44.008106 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: WARNING keystonemiddleware.auth_token [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 12:11:44.026092 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: WARNING keystonemiddleware.auth_token [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 12:11:44.033302 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: WARNING keystonemiddleware.auth_token [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 12:11:44.350332 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: WARNING keystonemiddleware.auth_token [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 12:11:44.356269 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: WARNING keystonemiddleware.auth_token [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 12:11:44.362132 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c76f1819c0 pid: 106115 (default app) Aug 18 12:11:44.364236 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:44.365414 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] 10.222.0.98 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001753 Aug 18 12:11:44.365826 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 1/1] 10.222.0.98 () {50 vars in 788 bytes} [Thu Aug 18 12:11:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:44.381533 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: WARNING keystonemiddleware.auth_token [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 12:11:44.387573 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: WARNING keystonemiddleware.auth_token [None req-eacc236d-c78b-4593-bf9f-afca79e2c2bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 12:11:44.393378 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c76f1819c0 pid: 106116 (default app) Aug 18 12:13:06.238927 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:06.240585 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002092 Aug 18 12:13:06.243731 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 2/2] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:06 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:06.257478 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG dbcounter [-] [106116] Writing DB stats nova_api:SELECT=3 {{(pid=106116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:06.258922 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG dbcounter [-] [106116] Writing DB stats nova_cell1:SELECT=3 {{(pid=106116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:06.259869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG dbcounter [-] [106116] Writing DB stats nova_cell0:SELECT=3 {{(pid=106116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:06.261086 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG dbcounter [-] [106116] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:07.159840 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-ecf460b0-fa6e-48ca-a046-b8092d00b175 admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:07.195523 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-ecf460b0-fa6e-48ca-a046-b8092d00b175 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.947249 Aug 18 12:13:07.196358 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 1/3] 10.222.0.98 () {60 vars in 1292 bytes} [Thu Aug 18 12:13:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:09.558118 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:09.559116 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-04a5f76e-e207-4121-8e70-80c7a51e35cb None None] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Aug 18 12:13:09.564623 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 3/4] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:09 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:10.022468 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-b3a96a8a-8357-4631-bf07-e50845f612bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "ram": 256}} {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:10.044023 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:13:10.044023 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: warnings.warn(msg) Aug 18 12:13:10.140238 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-b3a96a8a-8357-4631-bf07-e50845f612bd admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.573905 Aug 18 12:13:10.142497 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 2/5] 10.222.0.98 () {64 vars in 1283 bytes} [Thu Aug 18 12:13:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:13:10.161213 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writing DB stats nova_api:SELECT=3 {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:10.162365 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writing DB stats nova_cell1:SELECT=3 {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:10.163398 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writing DB stats nova_cell0:SELECT=3 {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:10.164550 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:10.374798 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-a0490ab5-875d-4aeb-88da-ad5c620f26f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:10.379208 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:13:10.379208 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: warnings.warn(msg) Aug 18 12:13:10.551737 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-a0490ab5-875d-4aeb-88da-ad5c620f26f9 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.401161 Aug 18 12:13:10.552250 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 4/6] 10.222.0.98 () {64 vars in 1336 bytes} [Thu Aug 18 12:13:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:12.949891 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-b3a96a8a-8357-4631-bf07-e50845f612bd admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:12.950919 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-b3a96a8a-8357-4631-bf07-e50845f612bd admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 18 12:13:12.951326 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 3/7] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:13.624458 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-f694eced-20d6-41c0-8eaf-8cb7d7d80c75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:13.643910 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:13:13.643910 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: warnings.warn(msg) Aug 18 12:13:13.757020 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-f694eced-20d6-41c0-8eaf-8cb7d7d80c75 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.798518 Aug 18 12:13:13.757936 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 5/8] 10.222.0.98 () {64 vars in 1283 bytes} [Thu Aug 18 12:13:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:13:13.770903 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-73b2f2ab-18cc-4a93-8d2d-53052da49ce2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:13.773735 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:13:13.773735 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: warnings.warn(msg) Aug 18 12:13:13.886277 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-73b2f2ab-18cc-4a93-8d2d-53052da49ce2 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119285 Aug 18 12:13:13.887459 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 4/9] 10.222.0.98 () {64 vars in 1336 bytes} [Thu Aug 18 12:13:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:16.222527 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-f694eced-20d6-41c0-8eaf-8cb7d7d80c75 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:16.223635 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-f694eced-20d6-41c0-8eaf-8cb7d7d80c75 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Aug 18 12:13:16.224071 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 6/10] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:16.640691 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-eb602811-2263-4d76-9e86-42d43c2c22ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G"}} {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:16.704085 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-eb602811-2263-4d76-9e86-42d43c2c22ad admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474053 Aug 18 12:13:16.704644 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 5/11] 10.222.0.98 () {64 vars in 1283 bytes} [Thu Aug 18 12:13:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:13:16.716778 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-3a09e16e-ed16-42ad-9e18-28ff9a12d9af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:16.775657 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-3a09e16e-ed16-42ad-9e18-28ff9a12d9af admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062682 Aug 18 12:13:16.776258 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 7/12] 10.222.0.98 () {64 vars in 1336 bytes} [Thu Aug 18 12:13:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:19.184468 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-eb602811-2263-4d76-9e86-42d43c2c22ad admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:19.186946 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-eb602811-2263-4d76-9e86-42d43c2c22ad admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002878 Aug 18 12:13:19.191699 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 6/13] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:19.675366 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-1d3658c8-ff9d-4fa3-bccb-0878a8d0b1fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "ram": 2048}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:19.755052 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-1d3658c8-ff9d-4fa3-bccb-0878a8d0b1fb admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.559284 Aug 18 12:13:19.755934 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 8/14] 10.222.0.98 () {64 vars in 1283 bytes} [Thu Aug 18 12:13:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:13:19.768916 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-1d8fe3c6-ab5e-4f49-857e-3b76d32d7eff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:19.872824 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-1d8fe3c6-ab5e-4f49-857e-3b76d32d7eff admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108091 Aug 18 12:13:19.873516 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 7/15] 10.222.0.98 () {64 vars in 1336 bytes} [Thu Aug 18 12:13:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:22.255404 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-1d3658c8-ff9d-4fa3-bccb-0878a8d0b1fb admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:22.256433 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-1d3658c8-ff9d-4fa3-bccb-0878a8d0b1fb admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 18 12:13:22.256835 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 9/16] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:22.684970 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-fdf14ab6-2f9a-4f23-9959-77a89663d63f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:22.788363 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-fdf14ab6-2f9a-4f23-9959-77a89663d63f admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.525013 Aug 18 12:13:22.788912 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 8/17] 10.222.0.98 () {64 vars in 1283 bytes} [Thu Aug 18 12:13:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:13:22.801471 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-b45dc9e9-a469-48d6-aafc-21a676a57d84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:22.874159 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-b45dc9e9-a469-48d6-aafc-21a676a57d84 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076418 Aug 18 12:13:22.874820 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 10/18] 10.222.0.98 () {64 vars in 1336 bytes} [Thu Aug 18 12:13:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:25.631166 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-fdf14ab6-2f9a-4f23-9959-77a89663d63f admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:25.632216 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-fdf14ab6-2f9a-4f23-9959-77a89663d63f admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 Aug 18 12:13:25.632624 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 9/19] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:26.106032 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-92a8307e-b3bf-443c-a73d-051d285abc91 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:26.131851 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-92a8307e-b3bf-443c-a73d-051d285abc91 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.492506 Aug 18 12:13:26.132556 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 11/20] 10.222.0.98 () {60 vars in 1292 bytes} [Thu Aug 18 12:13:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:13:28.581669 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-fdf14ab6-2f9a-4f23-9959-77a89663d63f admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:28.583072 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-fdf14ab6-2f9a-4f23-9959-77a89663d63f admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001930 Aug 18 12:13:28.583700 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 10/21] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:29.021484 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-b033d6e6-b770-448c-acf1-f5bc133f9127 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:29.117649 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-b033d6e6-b770-448c-acf1-f5bc133f9127 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.526592 Aug 18 12:13:29.117649 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 12/22] 10.222.0.98 () {64 vars in 1283 bytes} [Thu Aug 18 12:13:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:13:29.134664 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-12072fea-f826-4a68-ac99-dbe79ec00b7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:29.204105 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-12072fea-f826-4a68-ac99-dbe79ec00b7e admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075910 Aug 18 12:13:29.204662 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 11/23] 10.222.0.98 () {64 vars in 1333 bytes} [Thu Aug 18 12:13:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:31.593973 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-b033d6e6-b770-448c-acf1-f5bc133f9127 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:31.594985 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-b033d6e6-b770-448c-acf1-f5bc133f9127 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Aug 18 12:13:31.595406 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 13/24] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:32.019959 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-9219c0cd-6c5e-47ae-91f9-0fc259d8636c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:32.108210 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-9219c0cd-6c5e-47ae-91f9-0fc259d8636c admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.505746 Aug 18 12:13:32.108790 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 12/25] 10.222.0.98 () {64 vars in 1283 bytes} [Thu Aug 18 12:13:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:13:32.121049 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-7236ff27-2699-46cb-8d62-bdbcc0053344 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:32.277764 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-7236ff27-2699-46cb-8d62-bdbcc0053344 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160352 Aug 18 12:13:32.278345 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 14/26] 10.222.0.98 () {64 vars in 1333 bytes} [Thu Aug 18 12:13:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:34.624960 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-9219c0cd-6c5e-47ae-91f9-0fc259d8636c admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:34.626589 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-9219c0cd-6c5e-47ae-91f9-0fc259d8636c admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 Aug 18 12:13:34.628094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 13/27] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:35.038907 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-47801d0e-ef99-46cb-b8bd-ff872f6720e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "id": "3", "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:35.153148 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-47801d0e-ef99-46cb-b8bd-ff872f6720e3 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.519488 Aug 18 12:13:35.153710 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 15/28] 10.222.0.98 () {64 vars in 1283 bytes} [Thu Aug 18 12:13:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:13:35.165659 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-31d149f9-aed2-4562-95d1-82637db17e82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:35.322990 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-31d149f9-aed2-4562-95d1-82637db17e82 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160826 Aug 18 12:13:35.323516 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 14/29] 10.222.0.98 () {64 vars in 1333 bytes} [Thu Aug 18 12:13:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:37.800722 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-47801d0e-ef99-46cb-b8bd-ff872f6720e3 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:37.801725 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-47801d0e-ef99-46cb-b8bd-ff872f6720e3 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 18 12:13:37.802119 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 16/30] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:38.271186 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-54362d73-ebee-4a67-aa36-e21026b7d177 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0}} {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:38.276936 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG dbcounter [-] [106116] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:38.347908 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-54362d73-ebee-4a67-aa36-e21026b7d177 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.539430 Aug 18 12:13:38.348977 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 15/31] 10.222.0.98 () {64 vars in 1283 bytes} [Thu Aug 18 12:13:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:13:38.361243 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-ad0de168-06b8-4b19-a819-de1b2631050d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:38.419584 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-ad0de168-06b8-4b19-a819-de1b2631050d admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062155 Aug 18 12:13:38.420692 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 17/32] 10.222.0.98 () {64 vars in 1333 bytes} [Thu Aug 18 12:13:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:40.792362 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-54362d73-ebee-4a67-aa36-e21026b7d177 admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:40.793380 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-54362d73-ebee-4a67-aa36-e21026b7d177 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 18 12:13:40.793785 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 16/33] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:13:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:41.284593 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-c5428bd3-24d8-4b7c-95ce-71921967222a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:41.291251 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:41.379481 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-c5428bd3-24d8-4b7c-95ce-71921967222a admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.579558 Aug 18 12:13:41.383222 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 18/34] 10.222.0.98 () {64 vars in 1283 bytes} [Thu Aug 18 12:13:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:13:41.396732 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-8fb9236e-0fba-496b-b439-a716df4ea1ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:41.481371 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-8fb9236e-0fba-496b-b439-a716df4ea1ac admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089049 Aug 18 12:13:41.482001 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 17/35] 10.222.0.98 () {64 vars in 1333 bytes} [Thu Aug 18 12:13:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:01.733672 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-c5428bd3-24d8-4b7c-95ce-71921967222a admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:01.734671 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-c5428bd3-24d8-4b7c-95ce-71921967222a admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Aug 18 12:14:01.735076 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 19/36] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:14:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:02.128999 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-d2797030-df21-456d-add2-af34aec15977 admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:02.147343 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-d2797030-df21-456d-add2-af34aec15977 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406193 Aug 18 12:14:02.151800 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 18/37] 10.222.0.98 () {60 vars in 1292 bytes} [Thu Aug 18 12:14:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:14:03.203742 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-c5428bd3-24d8-4b7c-95ce-71921967222a admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:03.204733 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-c5428bd3-24d8-4b7c-95ce-71921967222a admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 18 12:14:03.205122 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 20/38] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:14:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:03.736950 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-8bf93747-109d-4c76-a217-b4ca8057149e admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:03.743913 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.wsgi [None req-8bf93747-109d-4c76-a217-b4ca8057149e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-8bf93747-109d-4c76-a217-b4ca8057149e admin admin] Request method failure captured: Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Accept: application/json Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Accept-Encoding: gzip, deflate Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Connection: keep-alive Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Content-Length: 0 Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Host: 10.222.0.98 Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Openstack-Api-Version: compute 2.90 Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Openstack-System-Scope: None Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: User-Agent: python-novaclient Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Auth-Token: gAAAAABi_i0LEfyg2O_f6Rm6W0vY8agyOqmgL6LkaMp_L6clZwIT41KRL7ZgmtPHsQtjKR2WaV-MCkt7SSFT6yiHNjAgV-6Y0HSbEusDn3Fdbci97H5DSa7ZTz36MmGXqb7UIj_0nXaQ-Yw7_A9RvCJCRi-J6qx-9fW67hVTOn_AM_t6TJKk2wQ Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Domain-Id: None Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Domain-Name: None Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Identity-Status: Confirmed Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Is-Admin-Project: True Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Domain-Id: default Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Domain-Name: Default Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Name: admin Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Role: member,admin,reader Aug 18 12:14:03.747234 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Roles: member,admin,reader Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c192a2eba4e24841893715c8478b559c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c192a2eba4e24841893715c8478b559c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Tenant: admin Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Tenant-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Tenant-Name: admin Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User: admin Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Domain-Id: default Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Domain-Name: Default Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Id: 6c92bf2b004241b3b54d40ae3aaaefe8 Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Name: admin Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: method: > Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: exception: Flavor 42 could not be found. Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: action_args: {'id': '42'} Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:14:03.749367 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:03.750205 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:03.755869 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-8bf93747-109d-4c76-a217-b4ca8057149e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106116) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:14:03.756983 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-8bf93747-109d-4c76-a217-b4ca8057149e admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.402176 Aug 18 12:14:03.756983 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 19/39] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Aug 18 12:14:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 12:14:03.759368 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-8be355b9-34f6-4f5d-8778-caa2d372b990 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:03.781502 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-8be355b9-34f6-4f5d-8778-caa2d372b990 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026077 Aug 18 12:14:03.782421 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 21/40] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Aug 18 12:14:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:14:03.792049 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-ee2c2324-b1fe-40f8-a01e-d96a945827e2 admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:03.817066 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-ee2c2324-b1fe-40f8-a01e-d96a945827e2 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028711 Aug 18 12:14:03.817632 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 20/41] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Aug 18 12:14:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:14:03.827385 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-69a559a6-13cd-4ddd-8a50-7647445ea216 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:03.833148 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.wsgi [None req-69a559a6-13cd-4ddd-8a50-7647445ea216 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-69a559a6-13cd-4ddd-8a50-7647445ea216 admin admin] Request method failure captured: Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Accept: application/json Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Accept-Encoding: gzip, deflate Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Connection: keep-alive Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Content-Length: 0 Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Host: 10.222.0.98 Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Openstack-Api-Version: compute 2.90 Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Openstack-System-Scope: None Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: User-Agent: python-novaclient Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Auth-Token: gAAAAABi_i0LEfyg2O_f6Rm6W0vY8agyOqmgL6LkaMp_L6clZwIT41KRL7ZgmtPHsQtjKR2WaV-MCkt7SSFT6yiHNjAgV-6Y0HSbEusDn3Fdbci97H5DSa7ZTz36MmGXqb7UIj_0nXaQ-Yw7_A9RvCJCRi-J6qx-9fW67hVTOn_AM_t6TJKk2wQ Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Domain-Id: None Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Domain-Name: None Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Identity-Status: Confirmed Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Is-Admin-Project: True Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Domain-Id: default Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Domain-Name: Default Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Name: admin Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Role: member,admin,reader Aug 18 12:14:03.836453 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Roles: member,admin,reader Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c192a2eba4e24841893715c8478b559c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c192a2eba4e24841893715c8478b559c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Tenant: admin Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Tenant-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Tenant-Name: admin Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User: admin Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Domain-Id: default Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Domain-Name: Default Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Id: 6c92bf2b004241b3b54d40ae3aaaefe8 Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Name: admin Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: method: > Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: exception: Flavor 42 could not be found. Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: action_args: {'id': '42'} Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:14:03.842926 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:03.844002 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:03.845275 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-69a559a6-13cd-4ddd-8a50-7647445ea216 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106115) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:14:03.846520 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-69a559a6-13cd-4ddd-8a50-7647445ea216 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014302 Aug 18 12:14:03.846520 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 22/42] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Aug 18 12:14:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 12:14:04.800449 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-ee2c2324-b1fe-40f8-a01e-d96a945827e2 admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:04.801489 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-ee2c2324-b1fe-40f8-a01e-d96a945827e2 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 18 12:14:04.801905 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 21/43] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:05.334757 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-c1edc1dd-1904-48f6-a456-7418ada78977 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:05.340584 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.wsgi [None req-c1edc1dd-1904-48f6-a456-7418ada78977 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-c1edc1dd-1904-48f6-a456-7418ada78977 admin admin] Request method failure captured: Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Accept: application/json Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Accept-Encoding: gzip, deflate Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Connection: keep-alive Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Content-Length: 0 Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Host: 10.222.0.98 Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Openstack-Api-Version: compute 2.90 Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Openstack-System-Scope: None Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: User-Agent: python-novaclient Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Auth-Token: gAAAAABi_i0MjxN3Jpv1VBFv367y9BRAVovSy4NT3OP3LpoaavZ5hDoT6CHCmTT3r91Uf6A_QyESslqIDO13gwt9zcGnEperPwFl4kv8HAxCy4sc2VtNi0DTZ3rsE5fOBjcxfaQgE3bIiwfc9heXxFXx-uslTL8ewDPSc1ut-Pj6RWbOM4ydGrk Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Domain-Id: None Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Domain-Name: None Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Identity-Status: Confirmed Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Is-Admin-Project: True Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Domain-Id: default Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Domain-Name: Default Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Name: admin Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Role: member,admin,reader Aug 18 12:14:05.341701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Roles: member,admin,reader Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c192a2eba4e24841893715c8478b559c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c192a2eba4e24841893715c8478b559c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Tenant: admin Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Tenant-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Tenant-Name: admin Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User: admin Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Domain-Id: default Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Domain-Name: Default Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Id: 6c92bf2b004241b3b54d40ae3aaaefe8 Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Name: admin Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: method: > Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: exception: Flavor 84 could not be found. Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: action_args: {'id': '84'} Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:14:05.343216 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:05.344298 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:05.345670 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-c1edc1dd-1904-48f6-a456-7418ada78977 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106115) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:14:05.347000 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-c1edc1dd-1904-48f6-a456-7418ada78977 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399984 Aug 18 12:14:05.347000 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 23/44] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Aug 18 12:14:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 12:14:05.352707 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-ff2a0572-4b99-4f85-bb93-8d30e3d2bf6a admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:05.368159 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-ff2a0572-4b99-4f85-bb93-8d30e3d2bf6a admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018945 Aug 18 12:14:05.368707 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 22/45] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Aug 18 12:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:14:05.379159 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-823cc72c-1390-47d8-b158-a70570b88c0b admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:05.394605 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-823cc72c-1390-47d8-b158-a70570b88c0b admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018890 Aug 18 12:14:05.395153 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 24/46] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Aug 18 12:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:14:05.404609 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-98d56aff-4672-4275-9781-add6b45eeebc admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:05.410049 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.wsgi [None req-98d56aff-4672-4275-9781-add6b45eeebc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-98d56aff-4672-4275-9781-add6b45eeebc admin admin] Request method failure captured: Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Accept: application/json Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Accept-Encoding: gzip, deflate Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Connection: keep-alive Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Content-Length: 0 Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Host: 10.222.0.98 Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Openstack-Api-Version: compute 2.90 Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Openstack-System-Scope: None Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: User-Agent: python-novaclient Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Auth-Token: gAAAAABi_i0MjxN3Jpv1VBFv367y9BRAVovSy4NT3OP3LpoaavZ5hDoT6CHCmTT3r91Uf6A_QyESslqIDO13gwt9zcGnEperPwFl4kv8HAxCy4sc2VtNi0DTZ3rsE5fOBjcxfaQgE3bIiwfc9heXxFXx-uslTL8ewDPSc1ut-Pj6RWbOM4ydGrk Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Domain-Id: None Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Domain-Name: None Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Identity-Status: Confirmed Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Is-Admin-Project: True Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Domain-Id: default Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Domain-Name: Default Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Name: admin Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Role: member,admin,reader Aug 18 12:14:05.411604 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Roles: member,admin,reader Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c192a2eba4e24841893715c8478b559c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c192a2eba4e24841893715c8478b559c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Tenant: admin Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Tenant-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Tenant-Name: admin Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User: admin Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Domain-Id: default Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Domain-Name: Default Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Id: 6c92bf2b004241b3b54d40ae3aaaefe8 Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Name: admin Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: method: > Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: exception: Flavor 84 could not be found. Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: action_args: {'id': '84'} Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:14:05.413181 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:05.414019 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:05.415094 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-98d56aff-4672-4275-9781-add6b45eeebc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106116) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:14:05.416394 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-98d56aff-4672-4275-9781-add6b45eeebc admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011899 Aug 18 12:14:05.416394 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 23/47] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Aug 18 12:14:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 18 12:14:06.391484 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-823cc72c-1390-47d8-b158-a70570b88c0b admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:06.392495 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-823cc72c-1390-47d8-b158-a70570b88c0b admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 18 12:14:06.392895 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 25/48] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:06.920645 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-ec236543-f683-4ae6-b2c4-bd3eaf14983b admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:06.926330 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.wsgi [None req-ec236543-f683-4ae6-b2c4-bd3eaf14983b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-ec236543-f683-4ae6-b2c4-bd3eaf14983b admin admin] Request method failure captured: Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Accept: application/json Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Accept-Encoding: gzip, deflate Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Connection: keep-alive Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Content-Length: 0 Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Host: 10.222.0.98 Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Openstack-Api-Version: compute 2.90 Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Openstack-System-Scope: None Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: User-Agent: python-novaclient Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Auth-Token: gAAAAABi_i0OI5ucMlae2GJliK67N4NhjPWSdzReT_B8KQr3g47CV052cSpYqlwAs-brLigIRB3NRw_vMSNG3_Cb9--w2bM0fZheVo0BtNQ-Wax77OGSFTp7NrZgv0-F9T-c7jJnk4EzqDW-8jVAf3tfi5si0-svYLBf69u2B5rleDiSMpRysjI Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Domain-Id: None Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Domain-Name: None Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Identity-Status: Confirmed Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Is-Admin-Project: True Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Domain-Id: default Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Domain-Name: Default Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Project-Name: admin Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Role: member,admin,reader Aug 18 12:14:06.927862 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Roles: member,admin,reader Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c192a2eba4e24841893715c8478b559c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c192a2eba4e24841893715c8478b559c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Tenant: admin Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Tenant-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-Tenant-Name: admin Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User: admin Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Domain-Id: default Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Domain-Name: Default Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Id: 6c92bf2b004241b3b54d40ae3aaaefe8 Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: X-User-Name: admin Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: method: > Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: exception: Flavor 451 could not be found. Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: action_args: {'id': '451'} Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:14:06.929251 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:06.930053 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: ERROR nova.api.openstack.wsgi Aug 18 12:14:06.931396 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-ec236543-f683-4ae6-b2c4-bd3eaf14983b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106116) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:14:06.932757 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-ec236543-f683-4ae6-b2c4-bd3eaf14983b admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393911 Aug 18 12:14:06.932757 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 24/49] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Aug 18 12:14:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 12:14:06.938896 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-fa87d72f-eb21-4b6e-88c0-225834824f07 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:06.954188 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-fa87d72f-eb21-4b6e-88c0-225834824f07 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018910 Aug 18 12:14:06.954708 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 26/50] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Aug 18 12:14:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:14:06.963952 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:06.979286 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018805 Aug 18 12:14:06.979856 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 25/51] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Aug 18 12:14:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:14:06.989126 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-748ea278-9b01-44cc-9b36-a014671e5449 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:06.994487 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.wsgi [None req-748ea278-9b01-44cc-9b36-a014671e5449 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-748ea278-9b01-44cc-9b36-a014671e5449 admin admin] Request method failure captured: Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Accept: application/json Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Accept-Encoding: gzip, deflate Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Connection: keep-alive Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Content-Length: 0 Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Host: 10.222.0.98 Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Openstack-Api-Version: compute 2.90 Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Openstack-System-Scope: None Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: User-Agent: python-novaclient Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Auth-Token: gAAAAABi_i0OI5ucMlae2GJliK67N4NhjPWSdzReT_B8KQr3g47CV052cSpYqlwAs-brLigIRB3NRw_vMSNG3_Cb9--w2bM0fZheVo0BtNQ-Wax77OGSFTp7NrZgv0-F9T-c7jJnk4EzqDW-8jVAf3tfi5si0-svYLBf69u2B5rleDiSMpRysjI Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Domain-Id: None Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Domain-Name: None Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Identity-Status: Confirmed Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Is-Admin-Project: True Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Domain-Id: default Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Domain-Name: Default Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Project-Name: admin Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Role: member,admin,reader Aug 18 12:14:06.996006 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Roles: member,admin,reader Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c192a2eba4e24841893715c8478b559c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c192a2eba4e24841893715c8478b559c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c192a2eba4e24841893715c8478b559c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Tenant: admin Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Tenant-Id: c192a2eba4e24841893715c8478b559c Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-Tenant-Name: admin Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User: admin Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Domain-Id: default Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Domain-Name: Default Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Id: 6c92bf2b004241b3b54d40ae3aaaefe8 Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: X-User-Name: admin Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: method: > Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: exception: Flavor 451 could not be found. Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: action_args: {'id': '451'} Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:14:06.997599 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:07.005090 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: ERROR nova.api.openstack.wsgi Aug 18 12:14:07.006375 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-748ea278-9b01-44cc-9b36-a014671e5449 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106115) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:14:07.007646 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-748ea278-9b01-44cc-9b36-a014671e5449 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011774 Aug 18 12:14:07.007646 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 27/52] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Aug 18 12:14:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 12:14:07.991898 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:07.992943 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 18 12:14:07.993344 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 26/53] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:14:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:08.526915 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-fe22fd3d-6c80-46be-aa25-2084ce0a09ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:08.629434 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-fe22fd3d-6c80-46be-aa25-2084ce0a09ab admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.495084 Aug 18 12:14:08.629903 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 28/54] 10.222.0.98 () {64 vars in 1235 bytes} [Thu Aug 18 12:14:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:14:09.608950 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:09.610007 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 18 12:14:09.610401 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 27/55] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:10.131656 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-f90b15eb-006d-4cef-9c87-801e8b63d5c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:10.234059 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-f90b15eb-006d-4cef-9c87-801e8b63d5c9 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.486247 Aug 18 12:14:10.234606 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 29/56] 10.222.0.98 () {64 vars in 1235 bytes} [Thu Aug 18 12:14:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:14:11.206887 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:11.208158 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001739 Aug 18 12:14:11.208550 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 28/57] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:14:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:11.738072 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-6f5948d6-fc1e-4174-beba-40d5a235b5f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:11.822892 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-6f5948d6-fc1e-4174-beba-40d5a235b5f7 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.476913 Aug 18 12:14:11.823471 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 30/58] 10.222.0.98 () {64 vars in 1235 bytes} [Thu Aug 18 12:14:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:14:12.809065 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:12.810112 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 18 12:14:12.810505 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 29/59] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:14:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:13.344701 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-da5825e8-17f7-4ab5-8ba2-8fcae1ce0d46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:13.468441 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-da5825e8-17f7-4ab5-8ba2-8fcae1ce0d46 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.507207 Aug 18 12:14:13.469036 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 31/60] 10.222.0.98 () {64 vars in 1235 bytes} [Thu Aug 18 12:14:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:14:14.440622 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:14.441617 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 18 12:14:14.442010 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 30/61] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:14:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:15.001789 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-238bb80b-0586-46c9-bad5-003bd55483a3 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:15.022620 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-238bb80b-0586-46c9-bad5-003bd55483a3 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412683 Aug 18 12:14:15.023159 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 32/62] 10.222.0.98 () {60 vars in 1202 bytes} [Thu Aug 18 12:14:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:15:08.936147 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:08.937157 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-7b187bab-c927-4f7c-b8e8-ce59f3bf157d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 18 12:15:08.937931 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 31/63] 10.222.0.98 () {54 vars in 931 bytes} [Thu Aug 18 12:15:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:15:08.948420 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:09.337452 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-3fd1e774-5ae9-4704-94bd-46a31b4d18a1 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:09.358608 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-3fd1e774-5ae9-4704-94bd-46a31b4d18a1 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.414640 Aug 18 12:15:09.359088 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 33/64] 10.222.0.98 () {60 vars in 1292 bytes} [Thu Aug 18 12:15:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:15:09.379791 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG dbcounter [-] [106116] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:09.383915 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-4f4a8514-50e8-439d-a19e-71afe2f0d56d admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:09.391566 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-4f4a8514-50e8-439d-a19e-71afe2f0d56d admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013248 Aug 18 12:15:09.392765 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 32/65] 10.222.0.98 () {60 vars in 1283 bytes} [Thu Aug 18 12:15:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:09.404481 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-c717436e-aaae-4165-a298-94b343e3b9c9 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:09.412125 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-c717436e-aaae-4165-a298-94b343e3b9c9 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011224 Aug 18 12:15:09.412651 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 34/66] 10.222.0.98 () {60 vars in 1286 bytes} [Thu Aug 18 12:15:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:09.425341 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-0ad2567e-470b-43b6-af96-f4c5af9a3b43 admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:09.433471 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-0ad2567e-470b-43b6-af96-f4c5af9a3b43 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012065 Aug 18 12:15:09.433993 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 33/67] 10.222.0.98 () {60 vars in 1286 bytes} [Thu Aug 18 12:15:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:09.445465 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-10d93dc0-eec0-4c77-9a99-1fd6690ad308 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:09.452994 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-10d93dc0-eec0-4c77-9a99-1fd6690ad308 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011118 Aug 18 12:15:09.453506 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 35/68] 10.222.0.98 () {60 vars in 1283 bytes} [Thu Aug 18 12:15:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:18:22.698795 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-0ad2567e-470b-43b6-af96-f4c5af9a3b43 admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:18:22.699833 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-0ad2567e-470b-43b6-af96-f4c5af9a3b43 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002247 Aug 18 12:18:22.700229 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 34/69] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:18:22.845607 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writing DB stats nova_api:SELECT=6 {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:18:23.011952 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-8c7fbf62-4f35-45db-b768-c7ea7a590f94 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:18:23.014357 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:18:23.014357 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: warnings.warn(msg) Aug 18 12:18:23.017994 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8c7fbf62-4f35-45db-b768-c7ea7a590f94 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:18:23.017994 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8c7fbf62-4f35-45db-b768-c7ea7a590f94 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:18:23.017994 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8c7fbf62-4f35-45db-b768-c7ea7a590f94 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:18:23.017994 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8c7fbf62-4f35-45db-b768-c7ea7a590f94 admin admin] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:18:23.017994 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8c7fbf62-4f35-45db-b768-c7ea7a590f94 admin admin] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:18:23.018422 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8c7fbf62-4f35-45db-b768-c7ea7a590f94 admin admin] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:18:23.055853 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-8c7fbf62-4f35-45db-b768-c7ea7a590f94 admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208933 Aug 18 12:18:23.055853 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 36/70] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Aug 18 12:18:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:18:23.888836 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-0ad2567e-470b-43b6-af96-f4c5af9a3b43 admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:18:23.889946 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-0ad2567e-470b-43b6-af96-f4c5af9a3b43 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 18 12:18:23.890372 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 35/71] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:18:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:18:24.086672 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-8a790007-c643-4496-8b27-8dd82ced7a53 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:18:24.089165 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:18:24.089165 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: warnings.warn(msg) Aug 18 12:18:24.090282 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8a790007-c643-4496-8b27-8dd82ced7a53 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:18:24.097923 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8a790007-c643-4496-8b27-8dd82ced7a53 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:18:24.097923 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8a790007-c643-4496-8b27-8dd82ced7a53 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:18:24.097923 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8a790007-c643-4496-8b27-8dd82ced7a53 admin admin] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:18:24.097923 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8a790007-c643-4496-8b27-8dd82ced7a53 admin admin] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:18:24.098331 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-8a790007-c643-4496-8b27-8dd82ced7a53 admin admin] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:18:24.112120 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-8a790007-c643-4496-8b27-8dd82ced7a53 admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080467 Aug 18 12:18:24.112672 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 37/72] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Aug 18 12:18:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:18:35.367206 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-0ad2567e-470b-43b6-af96-f4c5af9a3b43 admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:18:35.368254 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-0ad2567e-470b-43b6-af96-f4c5af9a3b43 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 18 12:18:35.368649 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 36/73] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:18:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:18:35.513226 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writing DB stats nova_cell0:SELECT=4 {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:18:35.514069 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writing DB stats nova_cell1:SELECT=4 {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:18:35.514700 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG dbcounter [-] [106115] Writing DB stats nova_api:SELECT=8 {{(pid=106115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:18:35.574815 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-c0bce7c8-da69-4204-a984-6a0155ee7b48 admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:18:35.577925 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:18:35.577925 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: warnings.warn(msg) Aug 18 12:18:35.579095 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-c0bce7c8-da69-4204-a984-6a0155ee7b48 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:18:35.579603 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-c0bce7c8-da69-4204-a984-6a0155ee7b48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:18:35.585013 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-c0bce7c8-da69-4204-a984-6a0155ee7b48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:18:35.585013 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-c0bce7c8-da69-4204-a984-6a0155ee7b48 admin admin] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:18:35.585013 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-c0bce7c8-da69-4204-a984-6a0155ee7b48 admin admin] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:18:35.585013 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-c0bce7c8-da69-4204-a984-6a0155ee7b48 admin admin] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:18:35.608255 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-c0bce7c8-da69-4204-a984-6a0155ee7b48 admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.100021 Aug 18 12:18:35.608814 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 38/74] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Aug 18 12:18:35 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:18:36.433403 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: DEBUG nova.api.openstack.wsgi [None req-0ad2567e-470b-43b6-af96-f4c5af9a3b43 admin admin] Calling method '>' {{(pid=106116) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:18:36.435051 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: INFO nova.api.openstack.requestlog [None req-0ad2567e-470b-43b6-af96-f4c5af9a3b43 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 18 12:18:36.435479 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: [pid: 106116|app: 0|req: 37/75] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Aug 18 12:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:18:36.631060 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG nova.api.openstack.wsgi [None req-5e41d055-6502-445e-be30-240804a8e74d admin admin] Calling method '>' {{(pid=106115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:18:36.633588 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:18:36.633588 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: warnings.warn(msg) Aug 18 12:18:36.634683 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-5e41d055-6502-445e-be30-240804a8e74d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:18:36.635201 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-5e41d055-6502-445e-be30-240804a8e74d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:18:36.635666 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-5e41d055-6502-445e-be30-240804a8e74d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:18:36.636389 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-5e41d055-6502-445e-be30-240804a8e74d admin admin] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:18:36.636834 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-5e41d055-6502-445e-be30-240804a8e74d admin admin] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:18:36.637250 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: DEBUG oslo_concurrency.lockutils [None req-5e41d055-6502-445e-be30-240804a8e74d admin admin] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:18:36.659007 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: INFO nova.api.openstack.requestlog [None req-5e41d055-6502-445e-be30-240804a8e74d admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080969 Aug 18 12:18:36.659602 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: [pid: 106115|app: 0|req: 39/76] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Aug 18 12:18:36 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:19:33.241474 dv-cinder-836027-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 18 12:19:33.242059 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: Thu Aug 18 12:19:33 2022 - graceful shutdown triggered... Aug 18 12:19:33.242555 dv-cinder-836027-7-iscsi devstack@n-api.service[106115]: Gracefully killing worker 1 (pid: 106115)... Aug 18 12:19:33.242914 dv-cinder-836027-7-iscsi devstack@n-api.service[106116]: Gracefully killing worker 2 (pid: 106116)... Aug 18 12:19:34.243212 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: worker 1 buried after 1 seconds Aug 18 12:19:34.243778 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: worker 2 buried after 1 seconds Aug 18 12:19:34.243778 dv-cinder-836027-7-iscsi devstack@n-api.service[106114]: goodbye to uWSGI. Aug 18 12:19:34.244872 dv-cinder-836027-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 18 12:19:34.245437 dv-cinder-836027-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 18 12:19:34.248279 dv-cinder-836027-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 12:19:34.259791 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 12:19:34.262051 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 12:19:34 2022] *** Aug 18 12:19:34.262051 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 12:19:34.262051 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 12:19:34.262051 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: nodename: dv-cinder-836027-7-iscsi Aug 18 12:19:34.262051 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: machine: x86_64 Aug 18 12:19:34.262051 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: clock source: unix Aug 18 12:19:34.262051 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: pcre jit disabled Aug 18 12:19:34.262051 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: detected number of CPU cores: 4 Aug 18 12:19:34.262051 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: current working directory: / Aug 18 12:19:34.262051 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: detected binary path: /usr/bin/uwsgi-core Aug 18 12:19:34.262694 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: your processes number limit is 47680 Aug 18 12:19:34.262694 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: your memory page size is 4096 bytes Aug 18 12:19:34.262694 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: detected max file descriptor number: 2048 Aug 18 12:19:34.262694 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: lock engine: pthread robust mutexes Aug 18 12:19:34.262694 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: thunder lock: enabled Aug 18 12:19:34.262694 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 12:19:34.262694 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 12:19:34.303059 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: Python main interpreter initialized at 0x555fa72889c0 Aug 18 12:19:34.303059 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: python threads support enabled Aug 18 12:19:34.303059 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: your server socket listen backlog is limited to 100 connections Aug 18 12:19:34.303059 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: your mercy for graceful operations on workers is 90 seconds Aug 18 12:19:34.303506 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 12:19:34.303506 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: *** Operational MODE: preforking *** Aug 18 12:19:34.303779 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: *** uWSGI is running in multiple interpreter mode *** Aug 18 12:19:34.303779 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: spawned uWSGI master process (pid: 121232) Aug 18 12:19:34.303991 dv-cinder-836027-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 12:19:34.304548 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: spawned uWSGI worker 1 (pid: 121244, cores: 1) Aug 18 12:19:34.304896 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: spawned uWSGI worker 2 (pid: 121245, cores: 1) Aug 18 12:19:34.305950 dv-cinder-836027-7-iscsi devstack@n-api.service[121232]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 12:19:34.989529 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 12:19:34.990266 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 12:19:36.148816 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 12:19:36.148816 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: from cryptography.utils import int_from_bytes Aug 18 12:19:36.149562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 12:19:36.149562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: from cryptography.utils import int_from_bytes Aug 18 12:19:36.152459 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 12:19:36.152459 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: from cryptography.utils import int_from_bytes Aug 18 12:19:36.152992 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 12:19:36.152992 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: from cryptography.utils import int_from_bytes Aug 18 12:19:38.478546 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 12:19:38.479109 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 12:19:38.479328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 12:19:38.479920 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 12:19:38.480342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 12:19:38.480898 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.481391 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.481869 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.482345 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.482843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.483323 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.483830 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.484323 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.484820 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.485259 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.485771 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.486050 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 12:19:38.486458 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 12:19:38.486815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-7-iscsi {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.486942 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 12:19:38.487197 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 12:19:38.487440 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.487567 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 12:19:38.487773 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.487884 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.488099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.488208 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.488430 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.488538 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.488747 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.488843 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.489076 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.489185 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.489402 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.489507 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.489755 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.489930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.491472 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.491596 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.491697 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.491782 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.491861 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.491946 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492028 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492100 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492171 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-7-iscsi {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492250 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492497 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492497 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492639 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492793 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.492943 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.493310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.493527 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.493767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.494087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-7-iscsi {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.494087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.494534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.494778 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.495000 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.495220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.495470 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.495470 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.495890 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.495890 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.496314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.496549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.496766 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.496995 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.497215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.497429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.497661 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.497880 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.498096 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.498279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.498501 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.498649 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.498839 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.499271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.499470 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-7-iscsi {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.499631 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.499783 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.499978 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.500137 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.500280 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.500422 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.500563 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.500712 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.500869 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.501021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.501176 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.501355 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.501511 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.501511 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.501792 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.501943 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.502712 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.502886 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.503040 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.503239 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.503398 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.503588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.503738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.503882 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.504104 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.504268 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.504421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.504564 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.504564 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.504855 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.505007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.505007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.505007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.505007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.505007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.505007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.505007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.508168 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.508324 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.508470 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.508626 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.508776 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.508934 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.509094 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.509247 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.509397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.509551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.509709 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.509859 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.510002 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.510152 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.510296 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.510446 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.510614 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.510758 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.510908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.510908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.511192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.511343 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.514685 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.514875 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.515031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.515180 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.515336 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.515549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.515708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.515708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.515708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.515708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.515708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.515708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.515708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.516686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.517339 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.517493 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.517636 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.517798 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.518005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.518163 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.518319 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.518462 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.518613 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.518765 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.518910 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.519053 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.519203 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.519354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.519537 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.519537 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.519820 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.519981 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.520133 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.520284 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.520441 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.520584 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.520726 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.520869 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.521169 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.521314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.521466 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.521616 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.521766 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.521910 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.522072 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.522228 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.522398 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.522550 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.522695 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.522838 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.522994 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.523154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.523154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.523154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.523154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.523154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.523154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.523154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.523154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.525101 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.525258 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.525418 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.525570 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.525714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.525714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.525994 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.526151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.526296 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.526446 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.526600 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.526750 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.526901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.527058 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.527210 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.527361 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.528166 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.528324 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.528484 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.528636 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.528787 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.528930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.529073 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.529236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.529395 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.529539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.529681 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.529823 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.529977 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.530120 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.531303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.531495 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.531647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.531804 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.531957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.532118 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.532263 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.532412 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.533111 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.533274 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.533425 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.533571 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.533714 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.533858 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.534009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.535031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.535209 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.535366 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.535572 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.535727 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.535878 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.536031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.536175 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.536326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.536478 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.536629 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.536794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.536947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.537098 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.537254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.537421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.537572 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.537723 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.537875 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.538044 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.538421 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.538573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.538716 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.538869 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.539012 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.539156 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.539312 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.539487 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.539655 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.539800 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.539951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.540094 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.540246 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.540391 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.540533 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.540683 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.540834 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.540988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.541139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.541283 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.541427 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.541588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.541739 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.541895 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.542049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.542200 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.542343 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.542732 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.542732 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.543021 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.543174 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.543326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.543531 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.543681 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.544007 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.544178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.544330 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.545010 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.545305 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.545412 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.545513 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.545600 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.545685 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.545781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.545877 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.545972 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.546071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.546166 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.546260 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.546345 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.546428 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 12:19:38.546513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.546603 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.546697 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.546783 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.546878 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.546970 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.547061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.547152 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.547249 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.547334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.547435 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.547522 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.547624 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.547711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.547809 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.547896 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.547986 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.548071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.548154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.548248 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.548333 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.548487 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.548585 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.548670 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.548762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.548875 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.548970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.549062 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.549153 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.549238 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.549329 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.549329 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.549497 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.549588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.549679 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.549771 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.549855 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.549947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.550033 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.550127 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.550211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.550295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.550402 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.550489 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.550573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.550656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.550739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.550829 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.550926 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.551019 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.551104 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.551188 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.551271 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.551362 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.551638 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.551738 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.551832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.551917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.552001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.552085 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.552182 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.552275 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.552367 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.552459 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.552551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.552645 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.552730 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.552822 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.552914 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.553005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.553090 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.553188 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.553292 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.553429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.553518 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.553602 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.553694 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.553854 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.553952 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.554038 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.554128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.554213 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.554296 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.554389 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.554389 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.554548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.554646 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.554757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.555114 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.555214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.555214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.555437 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.555515 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.555662 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.555765 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.555858 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.555950 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.556035 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.556117 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.556201 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.556293 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.556378 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.556468 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.556560 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.556645 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.556736 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.556834 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.556919 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557093 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557093 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557259 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557625 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557709 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557808 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557894 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.557984 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.558075 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.558165 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.558255 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.558351 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.558436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.558568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.558656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.558748 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.558832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.558928 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.559021 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.559105 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.559196 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.559281 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.559281 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.559495 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.559592 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.559685 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.559778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.559863 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.559959 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.560052 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.560276 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.560377 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.560588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.560686 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.560910 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.561010 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.561227 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.561327 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.561548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.561657 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.561864 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.561964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.562181 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.562271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.562495 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.562586 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.562815 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.562916 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.563135 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.563234 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.563497 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.563607 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.563848 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.563947 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.564168 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.564258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.564483 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.564581 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.564811 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.564935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.565279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.565379 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.565461 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.565547 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.565726 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.565863 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.566040 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.566132 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.566349 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.566459 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.566658 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.566749 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.566972 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.567071 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.567280 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.567372 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.567614 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.567721 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.567924 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.568024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.568234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.568334 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.568543 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.568677 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.568879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.568975 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.569186 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.569315 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.569499 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.569589 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.570477 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.570662 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.570830 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.570992 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.570992 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.571290 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.571471 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.571642 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.571802 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.571962 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.572126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.572277 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.572436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.572602 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.572760 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.572918 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.573077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.573227 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.573391 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.573556 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.573714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.573865 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.574022 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.574184 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.574334 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.574499 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.574657 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.574808 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.574958 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.575379 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.575565 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.575748 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.575901 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.576051 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.576209 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.576361 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.576538 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.576690 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.576861 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.577021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.577135 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.577224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.577319 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.577413 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.577499 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.577628 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.577713 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.577793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.577874 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.577968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.578061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.578153 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.578246 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.578330 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.578421 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.578545 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.578717 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.578819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.578912 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.579077 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.579164 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.579902 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.579996 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.580085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.580245 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.580363 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.580508 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.580656 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.580864 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.581036 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.581135 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.581288 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.581414 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.581605 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.581747 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.581937 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.582075 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.582259 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.582368 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.582584 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.582692 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.582892 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.583003 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.583211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.583307 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.583570 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.583670 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.583911 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.584022 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.584223 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.584317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.584545 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.584636 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.584864 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.584967 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.585180 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.585279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.585500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.585671 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.585826 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.586009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.586154 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.586293 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.586434 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.586581 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.586730 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.586879 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.587028 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.587155 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.587345 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.587516 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.587688 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.587790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.588000 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.588101 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.588314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.588407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.588627 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.588729 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.588940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.589219 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.589321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.589572 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.589681 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.589874 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.589964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.590191 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.590290 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.590516 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.590608 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.590842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.590941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.591154 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.591289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.591485 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.591583 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.591815 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.591922 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.592130 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.592235 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.592441 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.592532 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.592747 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.592852 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.593055 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.593154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.593405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.593506 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.593720 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.593821 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.594030 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.594132 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.594340 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.594431 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.594655 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.594760 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.595012 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.595843 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.595953 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.596049 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.596157 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.596264 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.596469 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.596570 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.596867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.596998 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.597194 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.597304 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.597512 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.597620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.597833 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.597933 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.598203 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.598305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.598527 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.598627 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.598848 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.598993 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.599158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.599260 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.599493 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.599590 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.599816 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.599919 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.600137 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.600230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.600449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.600549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.600769 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.600871 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.601094 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.601193 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.601418 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.601676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.601777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.602017 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.602119 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.602331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.602422 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.602640 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.602739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.602947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.603040 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.603258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.603350 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.603596 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.603817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.603931 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.604020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.604212 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.604312 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.604527 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.604669 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.604844 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.604935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.605157 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.605468 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.605964 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.606148 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.606312 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.606472 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.606624 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.606795 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.606957 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.607116 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.607274 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.607463 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.607651 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.607805 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.607963 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.608123 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.608275 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.608432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.608592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.608744 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.608895 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.608895 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.609182 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.609331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.609491 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.609660 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.609811 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.609970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.610129 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.610280 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.610503 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.610657 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.610807 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.610957 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.611091 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.611197 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.611311 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.611529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.611655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.611780 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.611893 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.612015 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.612136 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.612250 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.612397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.612524 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.612856 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.612985 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.613084 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.613173 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.613376 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.613521 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.613693 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.613800 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.614014 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.614115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.614322 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.614415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.614634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.614726 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.614943 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.615036 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.615250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.615350 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.615581 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.615676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.615927 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.616070 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.616214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.616323 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.616524 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.616619 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.616831 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.616921 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.617139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.617238 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.617445 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.617540 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.617756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.617847 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.618068 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.618170 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.618375 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.618474 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.618682 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.618781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.619003 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.619109 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.619318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.619450 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.619653 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.619774 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.620036 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.620185 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.620288 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.620375 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.620579 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.620681 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.620888 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.621037 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.621408 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.621536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.621630 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.621718 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.621817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.621915 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.622115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.622233 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.622424 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.622524 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.622734 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.622830 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.623049 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.623151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.623362 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.623491 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.623695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.623797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.624281 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.624378 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.624600 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.624697 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.624908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.625011 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.625218 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.625313 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.625531 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.625661 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.625840 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.625943 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.626194 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.626304 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.626488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.626597 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.626815 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.626913 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.627134 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.627235 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.627536 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.627656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.627778 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.627872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.628087 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.628189 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.628397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.628502 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.628708 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.628803 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.629021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.629116 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.629330 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.629426 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.629638 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.629739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.629944 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.630046 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.630253 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.630350 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.630560 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.630653 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.630886 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.631004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.631202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.631371 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.631567 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.631715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.631854 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.632008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.632167 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.632306 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.632449 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.632590 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.632731 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.632882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.633113 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.633208 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.633426 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.633564 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.633750 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.633894 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.634057 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.634194 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.634373 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.634514 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.634689 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.634843 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.634990 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.635129 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.635305 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.635473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.635637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.635793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.635940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.636079 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.636276 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.636404 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.636562 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.636665 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.636872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.636964 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.637199 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.637370 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.637532 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.637693 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.637855 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.638005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.638155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.638324 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.638687 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.638842 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.638842 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.639137 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.639297 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.639542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.639542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.639872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.639872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.640204 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.640204 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.640620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.640783 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.640936 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.641239 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.641408 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.641408 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.641408 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.643746 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.644521 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.644691 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.644864 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.645018 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.645186 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.645340 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.645500 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.645659 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.645820 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.645820 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.646142 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.646705 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.646873 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.647036 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.647188 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.647367 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.647367 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.647685 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.647849 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.647849 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.648290 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.648456 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.648456 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.648816 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.648978 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.650114 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.650281 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.650766 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.650955 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.650955 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.651481 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.651660 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.651660 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.652036 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.652202 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.652364 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.652524 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.652524 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.652831 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.652992 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.653157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.653316 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.653316 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.653704 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.653829 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.653935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.653935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.654066 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.654066 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.654210 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.654298 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.654372 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.654451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.654537 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.654623 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.654729 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.654808 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.654937 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655015 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655094 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655176 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655260 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655334 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655535 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655610 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655692 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655918 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.655989 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656067 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656153 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656227 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656384 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656457 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656616 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656826 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.656903 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.657080 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.657347 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.658074 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.658233 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.658386 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.658574 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.658744 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.658943 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.659088 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.659283 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.659492 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.659641 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.659752 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.659984 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.660106 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.660317 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.660461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.660656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.661187 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.661381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.661764 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.661894 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.662017 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.662159 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.662271 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.662368 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.662454 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.662539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.662716 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.662860 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.663173 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.663268 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.663353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.663510 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.663635 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.663788 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.663788 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.663958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.664045 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.664137 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.664266 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.664368 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.664592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.664685 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.664900 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.665047 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.665227 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.665383 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.665541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.665708 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.665849 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.666041 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.666144 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.666377 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.666478 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.666694 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.666788 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.667009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.667111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.667330 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.667452 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.667669 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.667764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.667984 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.668078 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.668320 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.668415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.668633 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.668770 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.668956 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.669060 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.669273 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.669378 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.669587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.669704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.669906 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.670040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.670225 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.670326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.670536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.670630 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.670859 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.670973 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.671180 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.671288 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.671527 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.671727 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.671854 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.672108 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.672216 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.672445 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.672553 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.672767 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.672874 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.673112 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.673214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.673431 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.673530 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.673745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.673845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.674061 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.674169 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.674375 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.674491 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.674695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.674809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.675013 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.675114 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.675402 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.675550 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.675693 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.675786 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.676016 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.676118 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.676346 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.676458 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.676680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.676784 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.677005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.677108 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.677324 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.677421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.677644 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.677740 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.677952 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.678052 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.678262 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.678381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.678577 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.678693 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.678891 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.679076 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.679195 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.679300 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.679520 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.679637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.679836 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.680001 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.680144 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.680241 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.680450 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.680546 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.680759 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.680863 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.681104 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.681248 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.681372 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.681603 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.681731 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.681861 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.681983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.682096 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.682291 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.682421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.682617 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.682751 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.682928 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.683056 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.683276 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.683606 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.683926 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.684358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.684507 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.684866 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.684958 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.685232 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.685364 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.685558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.685756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.685897 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.686191 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.686312 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.686415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.686543 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.686732 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.686871 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.687055 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.687199 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.687392 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.687548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.687728 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.687863 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.688040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.688191 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.688359 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.688513 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.688688 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.688975 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.689112 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.689213 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.689319 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.690131 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.690219 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.690294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.690404 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.690741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.691081 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.691399 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.692028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.692348 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.692735 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.692932 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.693038 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.693299 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.693408 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.693647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.693756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.694077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.694407 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.694768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.695029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.695153 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.695351 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.695696 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.695787 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.695872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.695995 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.696103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.696324 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.696475 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.696613 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.696716 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.696926 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.697027 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.697240 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.697364 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.697555 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.697708 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.697864 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.698065 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.698198 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.698401 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.698503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.698732 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.698849 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.699056 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.699164 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.699380 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.699543 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.699807 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.699940 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.700139 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.700265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.700569 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.700708 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.700838 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.700952 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.701072 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.701205 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.701338 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.701490 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.701642 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.701771 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.701951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.702054 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.702267 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.702370 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.702575 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.702667 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.702885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.702979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.703192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.703299 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.703541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.703652 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.703853 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.703953 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.704204 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.704890 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.705060 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.705156 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.705374 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.705474 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.705701 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.705804 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.706015 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.706115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.706347 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.706473 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.706689 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.706902 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.707004 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.707233 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.707579 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.707689 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.707917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.708020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.708244 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.708359 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.708568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.708665 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.708901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.709033 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.709210 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.709327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.709518 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.709632 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.709828 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.709942 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.710155 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.710268 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.710470 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.710584 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.710781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.710892 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.711093 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.711222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.711496 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.711668 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.711767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.711852 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.712044 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.712136 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.712359 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.712470 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.712668 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.712902 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.712998 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.713259 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.713367 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.713583 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.713711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.713887 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.713982 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.714298 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.714421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.714517 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.714610 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.714812 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.714906 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.715148 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.715254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.715496 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.715606 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.715820 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.715922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.716142 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.716242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.716461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.716604 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.716783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.716895 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.717080 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.717181 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.717391 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.717485 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.717704 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.717796 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.718017 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.718119 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.718333 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.718426 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.718646 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.718799 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.719022 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.719160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.719301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.719442 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.719643 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.719777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.719914 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.720696 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.721031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.721354 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.721535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.721883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.722204 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.722524 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.722839 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.723164 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.723542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.723774 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.723873 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.724130 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.724224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.724518 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.724620 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.724872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.725038 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.725193 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.725329 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.725517 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.725691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.725848 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.726063 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.726166 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.726419 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.726523 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.726771 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.726903 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.727121 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.727424 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.727535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.727780 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.727885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.728104 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.728243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.728463 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.728784 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.728894 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.729170 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.729350 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.729615 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.729720 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.730007 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.730112 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.730354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.730500 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.730694 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.730978 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.731083 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.731309 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.731405 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.731671 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.732033 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.732136 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.732322 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.732478 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.732640 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.732867 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.732963 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.733260 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.733380 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.736115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.736239 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.736341 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.736430 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.736522 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.736609 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.736692 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.736775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.736877 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.736951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.737029 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.737114 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.737211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.737294 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.737294 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.737294 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.737837 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.738227 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.738336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.738712 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.738813 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.739056 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.739164 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.739406 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.739554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.739800 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.739912 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.740147 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.740420 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.740532 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.740616 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.740877 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.740974 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.741160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.741265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.741468 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.741568 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.741795 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.742071 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.742214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.742584 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.742689 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.742775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.742851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.743107 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.743219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.743449 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.743552 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.743747 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.743851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.744052 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.744159 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.744364 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.744533 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.744707 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.744801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.744993 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.745169 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.745337 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.745504 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.745666 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.745824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.746010 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.746113 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.746298 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.746460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.746628 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.746795 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.746969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.747072 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.747392 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.747601 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.747824 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.747933 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.748133 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.748384 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.748460 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.748534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.748805 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.749166 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.749362 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.749526 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.749682 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.749867 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.750035 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.750271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.750443 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.750611 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.750766 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.750920 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.751074 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.751845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.752011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.752174 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.752334 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.752497 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.752755 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.753441 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.753620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.753779 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.753953 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.754109 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.754273 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.754428 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.754582 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.754735 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.754906 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.755061 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.755229 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.755384 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.755593 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.755758 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.755758 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.756065 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.756246 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.756547 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.756708 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.756872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.757028 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.757197 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.757352 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.757535 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.757535 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 12:19:38.757935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.757935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.757935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.757935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.757935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.758804 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.758804 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.758804 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.759253 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.759406 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.762898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.762898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.762898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.762898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.762898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.762898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.762898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.762898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.765799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.765799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.765799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.765799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.765799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.765799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.765799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.765799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.768021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.768021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.768021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.768021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.768021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.768021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.768021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.768021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.769206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.769206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.769206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.769206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.769206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.769206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.769206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.770254 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.770254 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.770254 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.770699 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.770859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.771138 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.771517 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.771860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.772183 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.772506 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.772883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 12:19:38.773269 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 12:19:38.925261 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO dbcounter [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Registered counter for database nova_api Aug 18 12:19:38.931219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO dbcounter [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Registered counter for database nova_api Aug 18 12:19:38.945804 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_db.sqlalchemy.engines [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:19:38.951336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_db.sqlalchemy.engines [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:19:38.952637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writer thread running {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:19:38.958351 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writer thread running {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:19:39.014926 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.context [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aac207c6-8c23-44cd-8489-7302b48d46d6(cell1) {{(pid=121244) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 12:19:39.016860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.context [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aac207c6-8c23-44cd-8489-7302b48d46d6(cell1) {{(pid=121245) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 12:19:39.019017 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:39.019595 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:39.020877 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:39.021195 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:39.021350 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:39.021947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:39.022394 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:39.022938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:39.023744 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:39.024190 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:39.024478 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:39.026193 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:39.026493 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO dbcounter [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Registered counter for database nova_cell0 Aug 18 12:19:39.028233 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO dbcounter [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Registered counter for database nova_cell0 Aug 18 12:19:39.030603 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO dbcounter [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Registered counter for database nova_cell1 Aug 18 12:19:39.032261 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO dbcounter [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Registered counter for database nova_cell1 Aug 18 12:19:39.038455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_db.sqlalchemy.engines [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:19:39.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_db.sqlalchemy.engines [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:19:39.042385 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_db.sqlalchemy.engines [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:19:39.044141 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_db.sqlalchemy.engines [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:19:39.046235 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writer thread running {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:19:39.050727 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writer thread running {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:19:39.052297 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writer thread running {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:19:39.053297 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writer thread running {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:19:39.198102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO dbcounter [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Registered counter for database nova_cell0 Aug 18 12:19:39.202132 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO dbcounter [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Registered counter for database nova_cell0 Aug 18 12:19:39.205420 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_db.sqlalchemy.engines [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:19:39.209676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_db.sqlalchemy.engines [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 12:19:39.210162 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writer thread running {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:19:39.214688 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writer thread running {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 12:19:39.529511 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: WARNING keystonemiddleware.auth_token [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 12:19:39.537730 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: WARNING keystonemiddleware.auth_token [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 12:19:39.538310 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: WARNING keystonemiddleware.auth_token [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 12:19:39.545264 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: WARNING keystonemiddleware.auth_token [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 12:19:39.889486 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: WARNING keystonemiddleware.auth_token [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 12:19:39.891724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: WARNING keystonemiddleware.auth_token [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 12:19:39.894702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: WARNING keystonemiddleware.auth_token [None req-e1be85d2-a45f-4635-9af5-0c04e0252c1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 12:19:39.897835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: WARNING keystonemiddleware.auth_token [None req-36c87223-7807-499a-b22b-21e17b120c4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 12:19:39.901060 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555fa72889c0 pid: 121244 (default app) Aug 18 12:19:39.904174 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555fa72889c0 pid: 121245 (default app) Aug 18 12:20:17.503145 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:17.505152 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:17.506250 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:17.507887 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:18.624028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-06859ee1-b964-4c56-8cb9-f048e07c8dad tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] Action: 'create', calling method: .version_select at 0x7f37960be280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1883191997", "metadata": {"Type": "work"}}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:20:20.514173 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-06859ee1-b964-4c56-8cb9-f048e07c8dad tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.925079 Aug 18 12:20:20.514173 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 1/1] 10.222.0.98 () {60 vars in 1156 bytes} [Thu Aug 18 12:20:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2928 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 12:20:20.520868 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-45b98bc2-35c5-483a-959b-3ed1d6519fca tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] Calling method '.version_select at 0x7f379616a3a0>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:20.528733 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6595a5f4-9b02-468e-ba6d-e6b53ac674fc tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] Calling method '.version_select at 0x7f3795f21160>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:20.529643 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=3 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:20.529643 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=3 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:20.529643 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=3 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:20.529643 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=3 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:20.586563 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6595a5f4-9b02-468e-ba6d-e6b53ac674fc tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb" status: 200 len: 353 microversion: 2.1 time: 0.139674 Aug 18 12:20:20.586563 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 2/2] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:20:20 2022] GET /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:21.125248 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-45b98bc2-35c5-483a-959b-3ed1d6519fca tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/6ea3781f-24c4-453d-99ab-9f41361de6ac" status: 200 len: 351 microversion: 2.1 time: 1.065288 Aug 18 12:20:21.125845 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 1/3] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:20:20 2022] GET /compute/v2.1/os-volumes/6ea3781f-24c4-453d-99ab-9f41361de6ac => generated 351 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:21.587916 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b9178628-d373-4837-9a3b-ae5740274ae0 tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] Calling method '.version_select at 0x7f3795f21820>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:21.881914 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b9178628-d373-4837-9a3b-ae5740274ae0 tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb" status: 200 len: 354 microversion: 2.1 time: 0.303727 Aug 18 12:20:21.884095 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 3/4] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:20:21 2022] GET /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb => generated 354 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:21.898328 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cc435a15-2bb3-4b14-adfc-dc59df8c1954 tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] Calling method '.version_select at 0x7f3795f7d430>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:22.142685 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cc435a15-2bb3-4b14-adfc-dc59df8c1954 tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb" status: 200 len: 354 microversion: 2.1 time: 0.249772 Aug 18 12:20:22.154130 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 2/5] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:20:21 2022] GET /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb => generated 354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:22.167636 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6f0e0fa7-561d-415a-926b-957521895c4d tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] Calling method '.version_select at 0x7f3795f21ee0>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:22.966746 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6f0e0fa7-561d-415a-926b-957521895c4d tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb" status: 202 len: 0 microversion: 2.1 time: 0.802474 Aug 18 12:20:22.966746 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 4/6] 10.222.0.98 () {58 vars in 1248 bytes} [Thu Aug 18 12:20:22 2022] DELETE /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:20:22.975693 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8a2d8c9e-9749-4035-8019-f5f42ca6ac1f tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] Calling method '.version_select at 0x7f3795f7d0d0>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:23.090420 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8a2d8c9e-9749-4035-8019-f5f42ca6ac1f tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb" status: 200 len: 353 microversion: 2.1 time: 0.120708 Aug 18 12:20:23.091166 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 3/7] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:20:22 2022] GET /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:24.109359 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e7c540da-b49e-43d7-869b-d9546aa2cf72 tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] Calling method '.version_select at 0x7f3795f21b80>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:24.181003 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-e7c540da-b49e-43d7-869b-d9546aa2cf72 tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] HTTP exception thrown: Volume a9381e37-59e2-48cc-8c25-a424963cf8bb could not be found. Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e7c540da-b49e-43d7-869b-d9546aa2cf72 tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] Request method failure captured: Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb HTTP/1.1 Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i6BzRRdrfTE3B7zma1EpCy8sUdfqkwNwY7qV_zcViFeyk1EWt3PS724T-Hai3zGAdDSh7-m09H94tluw1gYmWSXtqGvcByVItSu-fwd7jEiSisXTn0GBKNvFYNzPB-IwZCdPNPGVsZ7s6H0ni-jOT4hLsd32WyYQLCL9a3UBr6hyNc Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 69a97ad9036941329090a7723cac0cb4 Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-VolumesGetTestJSON-1880857944 Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:20:24.193411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/69a97ad9036941329090a7723cac0cb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/69a97ad9036941329090a7723cac0cb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/69a97ad9036941329090a7723cac0cb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_69a97ad9036941329090a7723cac0cb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-VolumesGetTestJSON-1880857944 Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 69a97ad9036941329090a7723cac0cb4 Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-VolumesGetTestJSON-1880857944 Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-VolumesGetTestJSON-1880857944-project Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 018b805cff9946c3b5878df51e6332fe Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-VolumesGetTestJSON-1880857944-project Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Volume a9381e37-59e2-48cc-8c25-a424963cf8bb could not be found. Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': 'a9381e37-59e2-48cc-8c25-a424963cf8bb'} Aug 18 12:20:24.197944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9381e37-59e2-48cc-8c25-a424963cf8bb could not be found. (HTTP 404) (Request-ID: req-eb12a8a5-4e8f-4e77-a373-12b5933d0590) Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:20:24.199490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:20:24.201741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9381e37-59e2-48cc-8c25-a424963cf8bb could not be found. Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 12:20:24.204403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9381e37-59e2-48cc-8c25-a424963cf8bb could not be found. Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9381e37-59e2-48cc-8c25-a424963cf8bb could not be found. Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:20:24.207827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e7c540da-b49e-43d7-869b-d9546aa2cf72 tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] Returning 404 to user: Volume a9381e37-59e2-48cc-8c25-a424963cf8bb could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:20:24.211385 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e7c540da-b49e-43d7-869b-d9546aa2cf72 tempest-VolumesGetTestJSON-1880857944 tempest-VolumesGetTestJSON-1880857944-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb" status: 404 len: 109 microversion: 2.1 time: 0.103869 Aug 18 12:20:24.211756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 5/8] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:20:24 2022] GET /compute/v2.1/os-volumes/a9381e37-59e2-48cc-8c25-a424963cf8bb => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:20:24.449369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e93d275d-b67c-4698-989f-1a152d6bf020 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] Calling method '.version_select at 0x7f3795f7dd30>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:24.553460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e93d275d-b67c-4698-989f-1a152d6bf020 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/eb5d2c4f-b33f-490c-ae36-3f4b23db9265" status: 200 len: 351 microversion: 2.1 time: 0.108410 Aug 18 12:20:24.554137 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 4/9] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:20:24 2022] GET /compute/v2.1/os-volumes/eb5d2c4f-b33f-490c-ae36-3f4b23db9265 => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:26.479599 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4b8b01b7-9639-473f-b6b8-cd90100faa4e tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] Calling method '.version_select at 0x7f37968fa820>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:26.631242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4b8b01b7-9639-473f-b6b8-cd90100faa4e tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/571b8b8c-03ea-4edf-b9be-543c50681ee4" status: 200 len: 351 microversion: 2.1 time: 0.163747 Aug 18 12:20:26.632934 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 6/10] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:20:26 2022] GET /compute/v2.1/os-volumes/571b8b8c-03ea-4edf-b9be-543c50681ee4 => generated 351 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:26.651242 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cd810e6c-6d20-4e10-bad1-c227b84ac689 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] Calling method '.version_select at 0x7f3795f0f310>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:26.945938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cd810e6c-6d20-4e10-bad1-c227b84ac689 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] 10.222.0.98 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.303199 Aug 18 12:20:26.946534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 5/11] 10.222.0.98 () {58 vars in 1134 bytes} [Thu Aug 18 12:20:26 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:26.964258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6d7f930d-22d9-4b91-8f19-e6df1b5cf9a4 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] Calling method '.version_select at 0x7f3795f21940>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:27.200945 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6d7f930d-22d9-4b91-8f19-e6df1b5cf9a4 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] 10.222.0.98 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.240469 Aug 18 12:20:27.214017 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 7/12] 10.222.0.98 () {58 vars in 1149 bytes} [Thu Aug 18 12:20:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:27.219038 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-20e4da70-3a3b-4691-a630-f005db14bd4f tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] Calling method '.version_select at 0x7f3795f7da60>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:27.512518 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-20e4da70-3a3b-4691-a630-f005db14bd4f tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] 10.222.0.98 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.299551 Aug 18 12:20:27.514170 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 6/13] 10.222.0.98 () {58 vars in 1134 bytes} [Thu Aug 18 12:20:27 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:27.529925 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f3fac1c6-44d5-4d11-b1f1-5bca213d9c33 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] Calling method '.version_select at 0x7f3795f2aaf0>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:28.021057 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f3fac1c6-44d5-4d11-b1f1-5bca213d9c33 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] 10.222.0.98 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.495595 Aug 18 12:20:28.022600 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 8/14] 10.222.0.98 () {58 vars in 1167 bytes} [Thu Aug 18 12:20:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:28.038073 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0b7b66c7-f8b3-49c2-b13f-93ad6d5f1b93 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] Calling method '.version_select at 0x7f3795f21310>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:28.256903 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0b7b66c7-f8b3-49c2-b13f-93ad6d5f1b93 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.223189 Aug 18 12:20:28.261327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 7/15] 10.222.0.98 () {58 vars in 1170 bytes} [Thu Aug 18 12:20:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:28.275402 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0ce1a01d-aca9-480e-a73e-1eca80845773 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] Calling method '.version_select at 0x7f3795f2a8b0>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:28.488877 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0ce1a01d-aca9-480e-a73e-1eca80845773 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.219522 Aug 18 12:20:28.489637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 9/16] 10.222.0.98 () {58 vars in 1155 bytes} [Thu Aug 18 12:20:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:28.508208 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-df8a138c-53f3-4ab6-bbd4-499d1047bfd6 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] Calling method '.version_select at 0x7f3795f21940>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:28.768513 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-df8a138c-53f3-4ab6-bbd4-499d1047bfd6 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.268871 Aug 18 12:20:28.772177 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 8/17] 10.222.0.98 () {58 vars in 1188 bytes} [Thu Aug 18 12:20:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:28.784523 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6e28cee7-a3f7-4f9f-92c8-f4362e72db29 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] Calling method '.version_select at 0x7f3795ee3a60>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:28.975327 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6e28cee7-a3f7-4f9f-92c8-f4362e72db29 tempest-VolumesTestJSON-1904387873 tempest-VolumesTestJSON-1904387873-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.197185 Aug 18 12:20:28.975930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 10/18] 10.222.0.98 () {58 vars in 1155 bytes} [Thu Aug 18 12:20:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:31.956516 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7cdebc9b-673d-4f47-be8e-ea2388a7cd0b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Action: 'create', calling method: .version_select at 0x7f3795f7d5e0>, body: {"keypair": {"name": "tempest-keypair-559355034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQugtGxyfSBjfW1sIq34msaSEEldZ+sZd+w7UoTs7eerF0Yco37CsbbQC8HNPo8lTcg9yrT5d3nW3QkIyaAAuXzbEu1XEH5opRTr53+aoUcUIACsB6YZIDTp2kSuvcS3g=="}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:20:32.065328 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-7cdebc9b-673d-4f47-be8e-ea2388a7cd0b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Getting quotas for project b1f3e22eb01045f299926f67cd36b91d. Resources: {'key_pairs'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:20:32.075913 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-7cdebc9b-673d-4f47-be8e-ea2388a7cd0b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Getting quotas for user b5113b1a77fd4b5da175b29b40d2b636 and project b1f3e22eb01045f299926f67cd36b91d. Resources: {'key_pairs'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:20:32.259789 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7cdebc9b-673d-4f47-be8e-ea2388a7cd0b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.002699 Aug 18 12:20:32.270952 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 9/19] 10.222.0.98 () {60 vars in 1159 bytes} [Thu Aug 18 12:20:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:32.368497 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1898577979", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:20:32.537808 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] validate_networks() for [('4fa2d47f-8432-41a3-92d6-82fa0a5852d4', None, None, None, None, None)] {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:20:33.522801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1015379225", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "networks": [{"uuid": "dfc6e576-2175-4920-a1ea-eb0cc4a2477b"}]}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:20:33.651787 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.network.neutron [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] validate_networks() for [('dfc6e576-2175-4920-a1ea-eb0cc4a2477b', None, None, None, None, None)] {{(pid=121245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:20:34.937059 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:20:34.938197 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:20:34.938680 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:20:34.939932 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:20:34.940631 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:20:34.973101 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:34.973848 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:34.974441 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:34.975363 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:34.976422 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:34.980822 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:35.055182 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Getting quotas for project 965cf5f488364e0ea8b52cdc78de2641. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:20:35.066926 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Getting quotas for user 2e8380a466484c83bca842518d171048 and project 965cf5f488364e0ea8b52cdc78de2641. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:20:35.139030 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:20:35.143592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:20:35.498635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c26b9e8d-e92f-4f11-945c-84cf4bef7237 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.552427 Aug 18 12:20:35.507994 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 11/20] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:20:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 3562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:20:35.517882 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b7a0436d-4190-48bf-8e64-27a61e1de40b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:35.517882 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b7a0436d-4190-48bf-8e64-27a61e1de40b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:35.825464 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b7a0436d-4190-48bf-8e64-27a61e1de40b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:35.873106 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b7a0436d-4190-48bf-8e64-27a61e1de40b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1222 microversion: 2.1 time: 0.363716 Aug 18 12:20:35.873699 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 12/21] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:35 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1222 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:36.213024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1912631608", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:20:36.236580 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Flavor limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:20:36.237128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Image limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:20:36.237456 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Flavor pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:20:36.237862 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Image pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:20:36.242851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:20:36.268285 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:36.268769 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:36.269206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:36.269933 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:36.270383 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:36.288984 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:36.375336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Getting quotas for project a95d3e9a225f45a88b06bee262207b6c. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:20:36.378192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] validate_networks() for [('4fa2d47f-8432-41a3-92d6-82fa0a5852d4', None, None, None, None, None)] {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:20:36.387018 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Getting quotas for user a830bd2267f948f693c6b211293c6b89 and project a95d3e9a225f45a88b06bee262207b6c. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:20:36.430655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Going to run 1 instances... {{(pid=121245) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:20:36.438361 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:20:36.708338 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c01533d0-4d2c-491c-a6cc-7e19c5aaeae6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.481956 Aug 18 12:20:36.711470 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 10/22] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:20:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:20:36.724004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c2111f64-7f2f-4939-af07-937e21c9bbda tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:36.726864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c2111f64-7f2f-4939-af07-937e21c9bbda tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:36.910795 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c2111f64-7f2f-4939-af07-937e21c9bbda tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:36.948482 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c2111f64-7f2f-4939-af07-937e21c9bbda tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1215 microversion: 2.1 time: 0.226496 Aug 18 12:20:36.953492 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 11/23] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:36 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1215 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:20:37.009172 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-93693817", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4609452-41da-45f9-867e-856dd6365cd4"}], "security_groups": [{"name": "tempest-securitygroup--1714394580"}], "key_name": "tempest-keypair-559355034", "user_data": "}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:20:37.231001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.network.neutron [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] validate_networks() for [('c4609452-41da-45f9-867e-856dd6365cd4', None, None, None, None, None)] {{(pid=121245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:20:37.488652 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:20:37.489704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:20:37.490408 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:20:37.491026 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:20:37.491683 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:20:37.501948 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:37.502707 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:37.503358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:37.504339 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:37.505343 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:37.506001 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:37.567391 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Getting quotas for project 965cf5f488364e0ea8b52cdc78de2641. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:20:37.581771 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Getting quotas for user 2e8380a466484c83bca842518d171048 and project 965cf5f488364e0ea8b52cdc78de2641. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:20:37.611563 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:20:37.614434 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:20:37.761289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-637fd548-a437-4b5d-a0c5-15066239edb1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.554046 Aug 18 12:20:37.763035 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 13/24] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:20:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:20:37.782217 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-af62e5c5-d7ba-40dd-9d21-9b3cd827775b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:37.783236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-af62e5c5-d7ba-40dd-9d21-9b3cd827775b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:37.896410 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-af62e5c5-d7ba-40dd-9d21-9b3cd827775b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:37.903993 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-af62e5c5-d7ba-40dd-9d21-9b3cd827775b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1222 microversion: 2.1 time: 0.128967 Aug 18 12:20:37.910852 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 14/25] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:37 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:37.976924 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-dfb7ed43-7451-48ed-a3ec-3cf892c13540 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:37.977612 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-dfb7ed43-7451-48ed-a3ec-3cf892c13540 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:38.138470 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-dfb7ed43-7451-48ed-a3ec-3cf892c13540 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:38.152922 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-dfb7ed43-7451-48ed-a3ec-3cf892c13540 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1215 microversion: 2.1 time: 0.177283 Aug 18 12:20:38.188858 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 15/26] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:37 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1215 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:20:38.340728 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Flavor limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:20:38.344718 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Image limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:20:38.344718 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Flavor pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:20:38.344718 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Image pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:20:38.344718 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:20:38.363111 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:38.363882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:38.364604 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:38.365628 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:38.366309 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:38.367337 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:38.405959 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Getting quotas for project b1f3e22eb01045f299926f67cd36b91d. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:20:38.424508 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Getting quotas for user b5113b1a77fd4b5da175b29b40d2b636 and project b1f3e22eb01045f299926f67cd36b91d. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:20:38.461063 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Going to run 1 instances... {{(pid=121245) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:20:38.463855 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:20:38.678604 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-88045481-2d8a-4ac6-b4b8-9ff2b7fcc897 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.673520 Aug 18 12:20:38.680149 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 12/27] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:20:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:20:38.697208 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-70d0522c-43e4-4467-a8e7-1ab92fa0f48e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:38.697208 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-70d0522c-43e4-4467-a8e7-1ab92fa0f48e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:38.894618 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-70d0522c-43e4-4467-a8e7-1ab92fa0f48e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:38.908167 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-70d0522c-43e4-4467-a8e7-1ab92fa0f48e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1235 microversion: 2.1 time: 0.220726 Aug 18 12:20:38.917150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 16/28] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:38 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1235 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:38.938592 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-adf33bfe-ec9f-41ed-ae14-4bf517890f61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:38.939222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-adf33bfe-ec9f-41ed-ae14-4bf517890f61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:39.175290 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-adf33bfe-ec9f-41ed-ae14-4bf517890f61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:39.175670 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4a0e7031-1438-49a2-9100-b7fcd7484b0e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:39.179341 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4a0e7031-1438-49a2-9100-b7fcd7484b0e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:39.202683 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-adf33bfe-ec9f-41ed-ae14-4bf517890f61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1222 microversion: 2.1 time: 0.265855 Aug 18 12:20:39.206991 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 13/29] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:38 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1222 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:39.375100 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4a0e7031-1438-49a2-9100-b7fcd7484b0e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:39.400511 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4a0e7031-1438-49a2-9100-b7fcd7484b0e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1215 microversion: 2.1 time: 0.229827 Aug 18 12:20:39.402549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 17/30] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:39 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1215 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:20:39.943633 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-037d7dc7-36b5-4b68-8322-a994382987fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:39.944155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-037d7dc7-36b5-4b68-8322-a994382987fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:40.015941 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-037d7dc7-36b5-4b68-8322-a994382987fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:40.023958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-037d7dc7-36b5-4b68-8322-a994382987fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1235 microversion: 2.1 time: 0.084623 Aug 18 12:20:40.025313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 14/31] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:39 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:40.229198 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-51b7fd29-5663-4a7f-94d2-b017907c46d8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:40.230715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-51b7fd29-5663-4a7f-94d2-b017907c46d8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:40.241596 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-51b7fd29-5663-4a7f-94d2-b017907c46d8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:40.242092 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-51b7fd29-5663-4a7f-94d2-b017907c46d8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:40.243162 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-51b7fd29-5663-4a7f-94d2-b017907c46d8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:40.243872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-51b7fd29-5663-4a7f-94d2-b017907c46d8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:40.245109 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-51b7fd29-5663-4a7f-94d2-b017907c46d8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:40.245962 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-51b7fd29-5663-4a7f-94d2-b017907c46d8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:40.428371 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b89761f5-987f-4381-813c-43a222fc38fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:40.428987 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b89761f5-987f-4381-813c-43a222fc38fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:40.435201 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-51b7fd29-5663-4a7f-94d2-b017907c46d8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:40.436300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b89761f5-987f-4381-813c-43a222fc38fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:40.436852 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b89761f5-987f-4381-813c-43a222fc38fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:40.437490 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b89761f5-987f-4381-813c-43a222fc38fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:40.438262 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b89761f5-987f-4381-813c-43a222fc38fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:40.438738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b89761f5-987f-4381-813c-43a222fc38fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:40.439153 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b89761f5-987f-4381-813c-43a222fc38fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:40.447670 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-51b7fd29-5663-4a7f-94d2-b017907c46d8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1226 microversion: 2.1 time: 0.222749 Aug 18 12:20:40.448581 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 18/32] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:40 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1226 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:40.578982 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b89761f5-987f-4381-813c-43a222fc38fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:40.590695 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b89761f5-987f-4381-813c-43a222fc38fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1219 microversion: 2.1 time: 0.166458 Aug 18 12:20:40.591534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 15/33] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:40 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:41.044857 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-7635a665-074d-4cac-85b2-ba5d41674b5d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:41.045996 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-7635a665-074d-4cac-85b2-ba5d41674b5d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:41.053330 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7635a665-074d-4cac-85b2-ba5d41674b5d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:41.054020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7635a665-074d-4cac-85b2-ba5d41674b5d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:41.054638 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7635a665-074d-4cac-85b2-ba5d41674b5d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:41.055733 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7635a665-074d-4cac-85b2-ba5d41674b5d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:41.056190 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7635a665-074d-4cac-85b2-ba5d41674b5d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:41.056958 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7635a665-074d-4cac-85b2-ba5d41674b5d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:41.270662 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-7635a665-074d-4cac-85b2-ba5d41674b5d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:41.278835 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-7635a665-074d-4cac-85b2-ba5d41674b5d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1239 microversion: 2.1 time: 0.237772 Aug 18 12:20:41.279671 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 19/34] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:41 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1239 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:41.471150 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-13a93f22-c7fe-4922-8a01-846f2a65c493 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:41.472275 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-13a93f22-c7fe-4922-8a01-846f2a65c493 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:41.478733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-13a93f22-c7fe-4922-8a01-846f2a65c493 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:41.483999 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-13a93f22-c7fe-4922-8a01-846f2a65c493 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:41.483999 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-13a93f22-c7fe-4922-8a01-846f2a65c493 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:41.483999 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-13a93f22-c7fe-4922-8a01-846f2a65c493 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:41.483999 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-13a93f22-c7fe-4922-8a01-846f2a65c493 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:41.484482 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-13a93f22-c7fe-4922-8a01-846f2a65c493 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:41.559820 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-13a93f22-c7fe-4922-8a01-846f2a65c493 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:41.569166 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-13a93f22-c7fe-4922-8a01-846f2a65c493 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1226 microversion: 2.1 time: 0.104500 Aug 18 12:20:41.570281 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 16/35] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:41 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:41.611570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4babc7a1-de36-4057-b2d6-cb6078466d3a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:41.612194 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4babc7a1-de36-4057-b2d6-cb6078466d3a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:41.618312 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4babc7a1-de36-4057-b2d6-cb6078466d3a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:41.618850 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4babc7a1-de36-4057-b2d6-cb6078466d3a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:41.619511 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4babc7a1-de36-4057-b2d6-cb6078466d3a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:41.620004 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4babc7a1-de36-4057-b2d6-cb6078466d3a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:41.620457 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4babc7a1-de36-4057-b2d6-cb6078466d3a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:41.620881 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4babc7a1-de36-4057-b2d6-cb6078466d3a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:41.684132 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4babc7a1-de36-4057-b2d6-cb6078466d3a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:41.691590 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4babc7a1-de36-4057-b2d6-cb6078466d3a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1219 microversion: 2.1 time: 0.083838 Aug 18 12:20:41.692167 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 20/36] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:41 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:42.300919 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4f2db1c7-417a-40b3-841b-0ae5dcb75727 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:42.302543 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-4f2db1c7-417a-40b3-841b-0ae5dcb75727 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:42.309039 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4f2db1c7-417a-40b3-841b-0ae5dcb75727 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:42.309522 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4f2db1c7-417a-40b3-841b-0ae5dcb75727 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:42.309962 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4f2db1c7-417a-40b3-841b-0ae5dcb75727 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:42.310716 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4f2db1c7-417a-40b3-841b-0ae5dcb75727 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:42.311806 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4f2db1c7-417a-40b3-841b-0ae5dcb75727 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:42.312235 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4f2db1c7-417a-40b3-841b-0ae5dcb75727 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:42.388950 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-4f2db1c7-417a-40b3-841b-0ae5dcb75727 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:42.396872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4f2db1c7-417a-40b3-841b-0ae5dcb75727 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1239 microversion: 2.1 time: 0.100383 Aug 18 12:20:42.397447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 17/37] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:42 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:20:42.591190 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-bf62ec56-24af-471c-af94-aaf41b3d8d62 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:42.594292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-bf62ec56-24af-471c-af94-aaf41b3d8d62 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:42.617600 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf62ec56-24af-471c-af94-aaf41b3d8d62 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:42.622767 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf62ec56-24af-471c-af94-aaf41b3d8d62 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:42.622767 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf62ec56-24af-471c-af94-aaf41b3d8d62 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:42.622767 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf62ec56-24af-471c-af94-aaf41b3d8d62 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:42.622767 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf62ec56-24af-471c-af94-aaf41b3d8d62 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:42.623503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf62ec56-24af-471c-af94-aaf41b3d8d62 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:42.712979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c9ac345f-6f08-4c74-9f4a-9edbf98775ab tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:42.713594 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c9ac345f-6f08-4c74-9f4a-9edbf98775ab tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:42.729316 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c9ac345f-6f08-4c74-9f4a-9edbf98775ab tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:42.730143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c9ac345f-6f08-4c74-9f4a-9edbf98775ab tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:42.730836 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c9ac345f-6f08-4c74-9f4a-9edbf98775ab tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:42.731784 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c9ac345f-6f08-4c74-9f4a-9edbf98775ab tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:42.732449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c9ac345f-6f08-4c74-9f4a-9edbf98775ab tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:42.733611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c9ac345f-6f08-4c74-9f4a-9edbf98775ab tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:42.741487 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bf62ec56-24af-471c-af94-aaf41b3d8d62 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:42.750224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-bf62ec56-24af-471c-af94-aaf41b3d8d62 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1226 microversion: 2.1 time: 0.163867 Aug 18 12:20:42.751140 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 21/38] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:42 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1226 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:42.822813 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c9ac345f-6f08-4c74-9f4a-9edbf98775ab tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:42.832417 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c9ac345f-6f08-4c74-9f4a-9edbf98775ab tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1219 microversion: 2.1 time: 0.123196 Aug 18 12:20:42.833004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 18/39] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:42 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:20:43.417909 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-cca40419-041c-4743-bf9b-7b77aa06836c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:43.418522 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-cca40419-041c-4743-bf9b-7b77aa06836c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:43.424620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cca40419-041c-4743-bf9b-7b77aa06836c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:43.425301 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cca40419-041c-4743-bf9b-7b77aa06836c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:43.425733 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cca40419-041c-4743-bf9b-7b77aa06836c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:43.426562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cca40419-041c-4743-bf9b-7b77aa06836c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:43.427015 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cca40419-041c-4743-bf9b-7b77aa06836c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:43.427452 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cca40419-041c-4743-bf9b-7b77aa06836c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:43.495999 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-cca40419-041c-4743-bf9b-7b77aa06836c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:43.504668 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-cca40419-041c-4743-bf9b-7b77aa06836c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1231 microversion: 2.1 time: 0.091041 Aug 18 12:20:43.505250 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 22/40] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:43 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1231 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:43.773998 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-898d7a0d-a8df-4493-ba5a-e96188ca4090 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:43.775334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-898d7a0d-a8df-4493-ba5a-e96188ca4090 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:43.784330 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898d7a0d-a8df-4493-ba5a-e96188ca4090 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:43.787003 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898d7a0d-a8df-4493-ba5a-e96188ca4090 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:43.787519 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898d7a0d-a8df-4493-ba5a-e96188ca4090 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:43.788254 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898d7a0d-a8df-4493-ba5a-e96188ca4090 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:43.788727 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898d7a0d-a8df-4493-ba5a-e96188ca4090 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:43.789140 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898d7a0d-a8df-4493-ba5a-e96188ca4090 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:43.853618 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-edd0c133-63a7-456f-88bb-b230573b0b38 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:43.854869 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-edd0c133-63a7-456f-88bb-b230573b0b38 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:43.859321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-898d7a0d-a8df-4493-ba5a-e96188ca4090 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:43.861899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edd0c133-63a7-456f-88bb-b230573b0b38 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:43.862416 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edd0c133-63a7-456f-88bb-b230573b0b38 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:43.862858 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edd0c133-63a7-456f-88bb-b230573b0b38 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:43.863805 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edd0c133-63a7-456f-88bb-b230573b0b38 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:43.864262 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edd0c133-63a7-456f-88bb-b230573b0b38 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:43.864694 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edd0c133-63a7-456f-88bb-b230573b0b38 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:43.866696 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-898d7a0d-a8df-4493-ba5a-e96188ca4090 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1218 microversion: 2.1 time: 0.097036 Aug 18 12:20:43.867434 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 19/41] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:43 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:43.930786 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-edd0c133-63a7-456f-88bb-b230573b0b38 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:43.938851 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-edd0c133-63a7-456f-88bb-b230573b0b38 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1211 microversion: 2.1 time: 0.089155 Aug 18 12:20:43.939419 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 23/42] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:43 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:20:44.535325 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ed85f8e2-d9e1-49ae-9b3e-18b42ecf1af0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:44.535892 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ed85f8e2-d9e1-49ae-9b3e-18b42ecf1af0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:44.541777 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed85f8e2-d9e1-49ae-9b3e-18b42ecf1af0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:44.542266 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed85f8e2-d9e1-49ae-9b3e-18b42ecf1af0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:44.542705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed85f8e2-d9e1-49ae-9b3e-18b42ecf1af0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:44.543466 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed85f8e2-d9e1-49ae-9b3e-18b42ecf1af0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:44.543928 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed85f8e2-d9e1-49ae-9b3e-18b42ecf1af0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:44.544360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed85f8e2-d9e1-49ae-9b3e-18b42ecf1af0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:44.606441 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ed85f8e2-d9e1-49ae-9b3e-18b42ecf1af0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:44.614571 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ed85f8e2-d9e1-49ae-9b3e-18b42ecf1af0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1231 microversion: 2.1 time: 0.083212 Aug 18 12:20:44.615140 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 20/43] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:44 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1231 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:44.896177 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c3bb4a14-dd5f-4553-b6b8-bccbfe2547fa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:44.898090 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c3bb4a14-dd5f-4553-b6b8-bccbfe2547fa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:44.908789 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bb4a14-dd5f-4553-b6b8-bccbfe2547fa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:44.909574 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bb4a14-dd5f-4553-b6b8-bccbfe2547fa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:44.910174 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bb4a14-dd5f-4553-b6b8-bccbfe2547fa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:44.914552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bb4a14-dd5f-4553-b6b8-bccbfe2547fa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:44.914552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bb4a14-dd5f-4553-b6b8-bccbfe2547fa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:44.914552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bb4a14-dd5f-4553-b6b8-bccbfe2547fa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:44.963604 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7301f4c1-9b02-4dd0-a6b5-0ae11f0897aa tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:44.965048 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7301f4c1-9b02-4dd0-a6b5-0ae11f0897aa tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:44.977860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7301f4c1-9b02-4dd0-a6b5-0ae11f0897aa tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:44.978371 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7301f4c1-9b02-4dd0-a6b5-0ae11f0897aa tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:44.978816 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7301f4c1-9b02-4dd0-a6b5-0ae11f0897aa tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:44.979615 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7301f4c1-9b02-4dd0-a6b5-0ae11f0897aa tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:44.980077 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7301f4c1-9b02-4dd0-a6b5-0ae11f0897aa tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:44.984175 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7301f4c1-9b02-4dd0-a6b5-0ae11f0897aa tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:44.999429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c3bb4a14-dd5f-4553-b6b8-bccbfe2547fa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:45.008471 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c3bb4a14-dd5f-4553-b6b8-bccbfe2547fa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1218 microversion: 2.1 time: 0.124422 Aug 18 12:20:45.009429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 24/44] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:44 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:45.081127 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7301f4c1-9b02-4dd0-a6b5-0ae11f0897aa tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:45.090780 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7301f4c1-9b02-4dd0-a6b5-0ae11f0897aa tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1211 microversion: 2.1 time: 0.131208 Aug 18 12:20:45.091594 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 21/45] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:44 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1211 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:20:45.636103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-1d8b7830-94ec-4e22-9415-ab22efc2882b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:45.637036 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-1d8b7830-94ec-4e22-9415-ab22efc2882b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:45.657656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1d8b7830-94ec-4e22-9415-ab22efc2882b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:45.658373 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1d8b7830-94ec-4e22-9415-ab22efc2882b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:45.659038 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1d8b7830-94ec-4e22-9415-ab22efc2882b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:45.659891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1d8b7830-94ec-4e22-9415-ab22efc2882b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:45.660410 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1d8b7830-94ec-4e22-9415-ab22efc2882b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:45.660960 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1d8b7830-94ec-4e22-9415-ab22efc2882b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:45.753506 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-1d8b7830-94ec-4e22-9415-ab22efc2882b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:45.762801 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-1d8b7830-94ec-4e22-9415-ab22efc2882b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1287 microversion: 2.1 time: 0.130501 Aug 18 12:20:45.763383 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 25/46] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:45 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:46.034104 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6fd73930-8bc4-41da-8bae-218c041d4297 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:46.034769 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-6fd73930-8bc4-41da-8bae-218c041d4297 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:46.040569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6fd73930-8bc4-41da-8bae-218c041d4297 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:46.041098 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6fd73930-8bc4-41da-8bae-218c041d4297 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:46.041540 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6fd73930-8bc4-41da-8bae-218c041d4297 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:46.042458 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6fd73930-8bc4-41da-8bae-218c041d4297 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:46.042691 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6fd73930-8bc4-41da-8bae-218c041d4297 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:46.043118 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6fd73930-8bc4-41da-8bae-218c041d4297 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:46.112353 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a27a36df-c739-4c55-a463-ac39eda0b874 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:46.113017 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a27a36df-c739-4c55-a463-ac39eda0b874 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:46.125885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a27a36df-c739-4c55-a463-ac39eda0b874 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:46.126548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a27a36df-c739-4c55-a463-ac39eda0b874 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:46.127581 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a27a36df-c739-4c55-a463-ac39eda0b874 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:46.130329 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a27a36df-c739-4c55-a463-ac39eda0b874 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:46.130896 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a27a36df-c739-4c55-a463-ac39eda0b874 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:46.132047 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-6fd73930-8bc4-41da-8bae-218c041d4297 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:46.133136 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a27a36df-c739-4c55-a463-ac39eda0b874 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:46.143106 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-6fd73930-8bc4-41da-8bae-218c041d4297 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1274 microversion: 2.1 time: 0.112678 Aug 18 12:20:46.144055 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 22/47] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:46 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:46.203092 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a27a36df-c739-4c55-a463-ac39eda0b874 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:46.211588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a27a36df-c739-4c55-a463-ac39eda0b874 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1267 microversion: 2.1 time: 0.104159 Aug 18 12:20:46.212945 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 26/48] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:46 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:46.790990 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8b52f322-5f30-4df7-b3af-d78ecc1e755c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:46.791666 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8b52f322-5f30-4df7-b3af-d78ecc1e755c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:46.809521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b52f322-5f30-4df7-b3af-d78ecc1e755c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:46.810024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b52f322-5f30-4df7-b3af-d78ecc1e755c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:46.810538 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b52f322-5f30-4df7-b3af-d78ecc1e755c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:46.811361 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b52f322-5f30-4df7-b3af-d78ecc1e755c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:46.821983 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b52f322-5f30-4df7-b3af-d78ecc1e755c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:46.823478 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b52f322-5f30-4df7-b3af-d78ecc1e755c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:47.002056 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8b52f322-5f30-4df7-b3af-d78ecc1e755c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:47.015838 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8b52f322-5f30-4df7-b3af-d78ecc1e755c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1295 microversion: 2.1 time: 0.234848 Aug 18 12:20:47.016438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 23/49] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:46 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1295 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:47.165384 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ca0b08ac-a762-4c2e-bcc8-a9b8768e56f9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:47.166001 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ca0b08ac-a762-4c2e-bcc8-a9b8768e56f9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:47.180600 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca0b08ac-a762-4c2e-bcc8-a9b8768e56f9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:47.181958 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca0b08ac-a762-4c2e-bcc8-a9b8768e56f9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:47.187813 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca0b08ac-a762-4c2e-bcc8-a9b8768e56f9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:47.191452 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca0b08ac-a762-4c2e-bcc8-a9b8768e56f9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:47.192061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca0b08ac-a762-4c2e-bcc8-a9b8768e56f9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:47.192514 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca0b08ac-a762-4c2e-bcc8-a9b8768e56f9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:47.234096 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f6171f0b-bedf-4c13-a585-599d535980f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:47.236174 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f6171f0b-bedf-4c13-a585-599d535980f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:47.252833 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6171f0b-bedf-4c13-a585-599d535980f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:47.253646 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6171f0b-bedf-4c13-a585-599d535980f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:47.255939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6171f0b-bedf-4c13-a585-599d535980f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:47.257523 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6171f0b-bedf-4c13-a585-599d535980f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:47.258784 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6171f0b-bedf-4c13-a585-599d535980f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:47.259476 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6171f0b-bedf-4c13-a585-599d535980f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:47.357512 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ca0b08ac-a762-4c2e-bcc8-a9b8768e56f9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:47.377419 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ca0b08ac-a762-4c2e-bcc8-a9b8768e56f9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1280 microversion: 2.1 time: 0.213770 Aug 18 12:20:47.379451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 27/50] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:47 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:47.642975 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f6171f0b-bedf-4c13-a585-599d535980f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:47.654682 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f6171f0b-bedf-4c13-a585-599d535980f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1275 microversion: 2.1 time: 0.424619 Aug 18 12:20:47.668518 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 24/51] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:47 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1275 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:48.044751 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d8d8cfc7-804c-4955-8a75-fc1d74c38153 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:48.045976 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d8d8cfc7-804c-4955-8a75-fc1d74c38153 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:48.049758 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=4 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:48.054871 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8d8cfc7-804c-4955-8a75-fc1d74c38153 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:48.055761 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8d8cfc7-804c-4955-8a75-fc1d74c38153 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:48.056205 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8d8cfc7-804c-4955-8a75-fc1d74c38153 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:48.057315 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8d8cfc7-804c-4955-8a75-fc1d74c38153 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:48.057647 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8d8cfc7-804c-4955-8a75-fc1d74c38153 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:48.058271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8d8cfc7-804c-4955-8a75-fc1d74c38153 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:48.220458 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d8d8cfc7-804c-4955-8a75-fc1d74c38153 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:48.233894 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d8d8cfc7-804c-4955-8a75-fc1d74c38153 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1293 microversion: 2.1 time: 0.197425 Aug 18 12:20:48.234956 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 28/52] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:48 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1293 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:48.402305 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fa96ed35-d8a0-4c52-9468-0fff32c68734 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:48.405163 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fa96ed35-d8a0-4c52-9468-0fff32c68734 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:48.411347 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=4 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:48.430092 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fa96ed35-d8a0-4c52-9468-0fff32c68734 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:48.430815 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fa96ed35-d8a0-4c52-9468-0fff32c68734 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:48.431672 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fa96ed35-d8a0-4c52-9468-0fff32c68734 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:48.432750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fa96ed35-d8a0-4c52-9468-0fff32c68734 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:48.433472 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fa96ed35-d8a0-4c52-9468-0fff32c68734 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:48.434350 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fa96ed35-d8a0-4c52-9468-0fff32c68734 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:48.532569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fa96ed35-d8a0-4c52-9468-0fff32c68734 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:48.546875 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fa96ed35-d8a0-4c52-9468-0fff32c68734 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1280 microversion: 2.1 time: 0.150348 Aug 18 12:20:48.559731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 25/53] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:48 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1280 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:48.699640 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4d054246-1e72-400a-b353-1c9257ad0479 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:48.700563 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4d054246-1e72-400a-b353-1c9257ad0479 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:48.713532 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d054246-1e72-400a-b353-1c9257ad0479 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:48.714091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d054246-1e72-400a-b353-1c9257ad0479 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:48.718637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d054246-1e72-400a-b353-1c9257ad0479 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:48.730758 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d054246-1e72-400a-b353-1c9257ad0479 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:48.731370 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d054246-1e72-400a-b353-1c9257ad0479 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:48.732491 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d054246-1e72-400a-b353-1c9257ad0479 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:48.892999 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4d054246-1e72-400a-b353-1c9257ad0479 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:48.919077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4d054246-1e72-400a-b353-1c9257ad0479 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1273 microversion: 2.1 time: 0.237446 Aug 18 12:20:48.950096 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 29/54] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:48 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1273 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:49.258724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6c8e2954-c38f-4835-9ad1-db34e8c3dcf0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:49.259344 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-6c8e2954-c38f-4835-9ad1-db34e8c3dcf0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:49.266873 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6c8e2954-c38f-4835-9ad1-db34e8c3dcf0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:49.267621 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6c8e2954-c38f-4835-9ad1-db34e8c3dcf0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:49.268317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6c8e2954-c38f-4835-9ad1-db34e8c3dcf0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:49.269425 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6c8e2954-c38f-4835-9ad1-db34e8c3dcf0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:49.270116 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6c8e2954-c38f-4835-9ad1-db34e8c3dcf0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:49.270743 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6c8e2954-c38f-4835-9ad1-db34e8c3dcf0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:49.424772 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-6c8e2954-c38f-4835-9ad1-db34e8c3dcf0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:49.455919 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-6c8e2954-c38f-4835-9ad1-db34e8c3dcf0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1293 microversion: 2.1 time: 0.199796 Aug 18 12:20:49.458542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 26/55] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:49 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1293 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:49.573114 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b1199ac7-7bee-4fb4-874a-6749dc19f33e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:49.573944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b1199ac7-7bee-4fb4-874a-6749dc19f33e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:49.585474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=22 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:49.590862 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b1199ac7-7bee-4fb4-874a-6749dc19f33e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:49.590862 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b1199ac7-7bee-4fb4-874a-6749dc19f33e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:49.590862 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b1199ac7-7bee-4fb4-874a-6749dc19f33e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:49.593480 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b1199ac7-7bee-4fb4-874a-6749dc19f33e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:49.594122 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b1199ac7-7bee-4fb4-874a-6749dc19f33e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:49.609897 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b1199ac7-7bee-4fb4-874a-6749dc19f33e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:49.966398 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bb0b4615-8f98-49ac-aee3-6fc1cf966d36 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:49.968521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bb0b4615-8f98-49ac-aee3-6fc1cf966d36 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:49.981223 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb0b4615-8f98-49ac-aee3-6fc1cf966d36 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:49.981829 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb0b4615-8f98-49ac-aee3-6fc1cf966d36 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:49.982303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb0b4615-8f98-49ac-aee3-6fc1cf966d36 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:49.984023 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb0b4615-8f98-49ac-aee3-6fc1cf966d36 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:49.985759 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb0b4615-8f98-49ac-aee3-6fc1cf966d36 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:49.986393 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb0b4615-8f98-49ac-aee3-6fc1cf966d36 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:50.023287 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=22 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:50.159076 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b1199ac7-7bee-4fb4-874a-6749dc19f33e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:50.173242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b1199ac7-7bee-4fb4-874a-6749dc19f33e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.605873 Aug 18 12:20:50.173929 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 30/56] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:49 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:50.482430 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ffd18368-7647-4b3f-803e-95c5056af00b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:50.483200 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ffd18368-7647-4b3f-803e-95c5056af00b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:50.508264 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ffd18368-7647-4b3f-803e-95c5056af00b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:50.508264 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ffd18368-7647-4b3f-803e-95c5056af00b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:50.510676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ffd18368-7647-4b3f-803e-95c5056af00b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:50.514928 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ffd18368-7647-4b3f-803e-95c5056af00b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:50.516503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ffd18368-7647-4b3f-803e-95c5056af00b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:50.518486 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ffd18368-7647-4b3f-803e-95c5056af00b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:50.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bb0b4615-8f98-49ac-aee3-6fc1cf966d36 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:50.755977 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-bb0b4615-8f98-49ac-aee3-6fc1cf966d36 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.793800 Aug 18 12:20:50.759803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 27/57] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:49 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:51.193979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6ee12910-e68a-4414-bdfc-2ad8299d352d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:51.195395 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-6ee12910-e68a-4414-bdfc-2ad8299d352d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:51.213210 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6ee12910-e68a-4414-bdfc-2ad8299d352d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:51.213699 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6ee12910-e68a-4414-bdfc-2ad8299d352d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:51.218174 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6ee12910-e68a-4414-bdfc-2ad8299d352d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:51.218941 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6ee12910-e68a-4414-bdfc-2ad8299d352d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:51.221204 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6ee12910-e68a-4414-bdfc-2ad8299d352d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:51.223571 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6ee12910-e68a-4414-bdfc-2ad8299d352d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:51.482587 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ffd18368-7647-4b3f-803e-95c5056af00b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:51.491990 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ffd18368-7647-4b3f-803e-95c5056af00b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 1.014859 Aug 18 12:20:51.507725 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 31/58] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:50 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:51.779059 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-38a92bec-4a92-4fda-9854-e9ffff6b3e04 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:51.779996 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-38a92bec-4a92-4fda-9854-e9ffff6b3e04 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:51.796560 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38a92bec-4a92-4fda-9854-e9ffff6b3e04 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:51.797394 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38a92bec-4a92-4fda-9854-e9ffff6b3e04 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:51.798046 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38a92bec-4a92-4fda-9854-e9ffff6b3e04 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:51.799085 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38a92bec-4a92-4fda-9854-e9ffff6b3e04 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:51.799788 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38a92bec-4a92-4fda-9854-e9ffff6b3e04 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:51.800488 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38a92bec-4a92-4fda-9854-e9ffff6b3e04 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:51.987303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-6ee12910-e68a-4414-bdfc-2ad8299d352d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:51.999305 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-6ee12910-e68a-4414-bdfc-2ad8299d352d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.808149 Aug 18 12:20:51.999933 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 28/59] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:51 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:52.321271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-38a92bec-4a92-4fda-9854-e9ffff6b3e04 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:52.350827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-38a92bec-4a92-4fda-9854-e9ffff6b3e04 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.574080 Aug 18 12:20:52.362869 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 32/60] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:51 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:52.522204 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d1590db5-7deb-4b24-a272-c3a3d1e9413a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:52.529907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d1590db5-7deb-4b24-a272-c3a3d1e9413a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:52.556564 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d1590db5-7deb-4b24-a272-c3a3d1e9413a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:52.557138 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d1590db5-7deb-4b24-a272-c3a3d1e9413a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:52.557514 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d1590db5-7deb-4b24-a272-c3a3d1e9413a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:52.565134 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d1590db5-7deb-4b24-a272-c3a3d1e9413a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:52.568946 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d1590db5-7deb-4b24-a272-c3a3d1e9413a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:52.569398 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d1590db5-7deb-4b24-a272-c3a3d1e9413a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:53.028401 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-4a008f01-94c2-4fc8-8b59-1ec0e915df16 req-5c89398e-c84d-41d2-9b1c-74b77af16f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d584dbe7-cf44-4182-8ee3-3a240b0a8f37", "tag": "d8111269-50cb-47be-baad-3ecc1d3bf9f9"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:20:53.052528 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-4a008f01-94c2-4fc8-8b59-1ec0e915df16 req-5c89398e-c84d-41d2-9b1c-74b77af16f0e service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:53.053847 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-4a008f01-94c2-4fc8-8b59-1ec0e915df16 req-5c89398e-c84d-41d2-9b1c-74b77af16f0e service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:53.054781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-4a008f01-94c2-4fc8-8b59-1ec0e915df16 req-5c89398e-c84d-41d2-9b1c-74b77af16f0e service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:53.080293 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-4a008f01-94c2-4fc8-8b59-1ec0e915df16 req-5c89398e-c84d-41d2-9b1c-74b77af16f0e service nova] Creating event network-changed:d8111269-50cb-47be-baad-3ecc1d3bf9f9 for instance d584dbe7-cf44-4182-8ee3-3a240b0a8f37 on hv-cinder-83602 Aug 18 12:20:53.081008 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-4a008f01-94c2-4fc8-8b59-1ec0e915df16 req-5c89398e-c84d-41d2-9b1c-74b77af16f0e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121244) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 12:20:53.081610 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-4a008f01-94c2-4fc8-8b59-1ec0e915df16 req-5c89398e-c84d-41d2-9b1c-74b77af16f0e service nova] Acquired lock "compute-rpcapi-router" {{(pid=121244) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 12:20:53.085151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87302598-33b0-41c1-9b4d-f5ea12467ee1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:53.086013 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87302598-33b0-41c1-9b4d-f5ea12467ee1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:53.086723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87302598-33b0-41c1-9b4d-f5ea12467ee1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:53.087834 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87302598-33b0-41c1-9b4d-f5ea12467ee1 None None] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:53.088475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87302598-33b0-41c1-9b4d-f5ea12467ee1 None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:53.089167 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87302598-33b0-41c1-9b4d-f5ea12467ee1 None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:53.100713 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.compute.rpcapi [None req-87302598-33b0-41c1-9b4d-f5ea12467ee1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 12:20:53.102084 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87302598-33b0-41c1-9b4d-f5ea12467ee1 None None] Releasing lock "compute-rpcapi-router" {{(pid=121244) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 12:20:53.149689 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-87302598-33b0-41c1-9b4d-f5ea12467ee1 None None] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220224 Aug 18 12:20:53.151114 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 33/61] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:53.157554 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-68bc9483-4559-4cb1-a001-4c19f8b007ac tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:53.158782 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-68bc9483-4559-4cb1-a001-4c19f8b007ac tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:53.173499 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-68bc9483-4559-4cb1-a001-4c19f8b007ac tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:53.174569 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-68bc9483-4559-4cb1-a001-4c19f8b007ac tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:53.175333 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-68bc9483-4559-4cb1-a001-4c19f8b007ac tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:53.183123 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-68bc9483-4559-4cb1-a001-4c19f8b007ac tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:53.183123 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-68bc9483-4559-4cb1-a001-4c19f8b007ac tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:53.183123 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-68bc9483-4559-4cb1-a001-4c19f8b007ac tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:53.183873 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=100 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:53.359085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d1590db5-7deb-4b24-a272-c3a3d1e9413a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:53.382277 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d1590db5-7deb-4b24-a272-c3a3d1e9413a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.871270 Aug 18 12:20:53.387200 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 29/62] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:52 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:53.403151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f133057e-c1ac-465c-b913-67e9329afdde tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:53.405135 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f133057e-c1ac-465c-b913-67e9329afdde tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:53.423731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f133057e-c1ac-465c-b913-67e9329afdde tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:53.424898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f133057e-c1ac-465c-b913-67e9329afdde tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:53.425995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f133057e-c1ac-465c-b913-67e9329afdde tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:53.428106 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f133057e-c1ac-465c-b913-67e9329afdde tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:53.428751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f133057e-c1ac-465c-b913-67e9329afdde tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:53.430253 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f133057e-c1ac-465c-b913-67e9329afdde tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:53.832399 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f133057e-c1ac-465c-b913-67e9329afdde tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:53.836400 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=100 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:53.841009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f133057e-c1ac-465c-b913-67e9329afdde tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.451197 Aug 18 12:20:53.850006 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 30/63] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:53 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:54.262680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-73ce8623-16a7-4d89-b463-3154deabc1b4 req-c6d968a9-562d-4cfe-ae4f-3ba91be19fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4aedfb-2e3b-400c-9c97-9a0939976eb2", "tag": "cd3bd10f-38d4-4066-b60f-99ec50c216c4"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:20:54.274073 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-68bc9483-4559-4cb1-a001-4c19f8b007ac tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:54.294166 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-68bc9483-4559-4cb1-a001-4c19f8b007ac tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 1.141124 Aug 18 12:20:54.295372 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 34/64] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:53 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:54.313922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-73ce8623-16a7-4d89-b463-3154deabc1b4 req-c6d968a9-562d-4cfe-ae4f-3ba91be19fbe service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:54.314707 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-73ce8623-16a7-4d89-b463-3154deabc1b4 req-c6d968a9-562d-4cfe-ae4f-3ba91be19fbe service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:54.315554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-73ce8623-16a7-4d89-b463-3154deabc1b4 req-c6d968a9-562d-4cfe-ae4f-3ba91be19fbe service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:54.337746 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-73ce8623-16a7-4d89-b463-3154deabc1b4 req-c6d968a9-562d-4cfe-ae4f-3ba91be19fbe service nova] Creating event network-changed:cd3bd10f-38d4-4066-b60f-99ec50c216c4 for instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 on hv-cinder-83602 Aug 18 12:20:54.339140 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-73ce8623-16a7-4d89-b463-3154deabc1b4 req-c6d968a9-562d-4cfe-ae4f-3ba91be19fbe service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121245) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 12:20:54.339827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-73ce8623-16a7-4d89-b463-3154deabc1b4 req-c6d968a9-562d-4cfe-ae4f-3ba91be19fbe service nova] Acquired lock "compute-rpcapi-router" {{(pid=121245) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 12:20:54.341754 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1e59cd8-358e-432f-a11c-0bd08fe16cf9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:54.343124 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1e59cd8-358e-432f-a11c-0bd08fe16cf9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:54.343968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1e59cd8-358e-432f-a11c-0bd08fe16cf9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:54.344962 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1e59cd8-358e-432f-a11c-0bd08fe16cf9 None None] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:54.345975 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1e59cd8-358e-432f-a11c-0bd08fe16cf9 None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:54.346616 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1e59cd8-358e-432f-a11c-0bd08fe16cf9 None None] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:54.358803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.compute.rpcapi [None req-e1e59cd8-358e-432f-a11c-0bd08fe16cf9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 12:20:54.360099 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1e59cd8-358e-432f-a11c-0bd08fe16cf9 None None] Releasing lock "compute-rpcapi-router" {{(pid=121245) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 12:20:54.379077 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e1e59cd8-358e-432f-a11c-0bd08fe16cf9 None None] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.521064 Aug 18 12:20:54.380052 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 31/65] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:20:54.411930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-521065e1-8c61-4321-b5c6-df16197dae78 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:54.412628 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-521065e1-8c61-4321-b5c6-df16197dae78 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:54.423278 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-521065e1-8c61-4321-b5c6-df16197dae78 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:54.423866 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-521065e1-8c61-4321-b5c6-df16197dae78 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:54.429054 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-521065e1-8c61-4321-b5c6-df16197dae78 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:54.429054 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-521065e1-8c61-4321-b5c6-df16197dae78 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:54.429054 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-521065e1-8c61-4321-b5c6-df16197dae78 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:54.429054 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-521065e1-8c61-4321-b5c6-df16197dae78 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:54.872296 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8713714a-c482-4f8d-857a-e34062d062e8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:54.874091 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8713714a-c482-4f8d-857a-e34062d062e8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:54.891220 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8713714a-c482-4f8d-857a-e34062d062e8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:54.893729 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8713714a-c482-4f8d-857a-e34062d062e8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:54.895174 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8713714a-c482-4f8d-857a-e34062d062e8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:54.896891 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8713714a-c482-4f8d-857a-e34062d062e8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:54.898970 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8713714a-c482-4f8d-857a-e34062d062e8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:54.900380 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8713714a-c482-4f8d-857a-e34062d062e8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:54.901126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-521065e1-8c61-4321-b5c6-df16197dae78 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:54.919941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-521065e1-8c61-4321-b5c6-df16197dae78 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.502636 Aug 18 12:20:54.934063 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 35/66] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:54 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:55.237876 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-5b8c4b2f-a2e5-4ae6-bd2a-ebfcb77d4541 req-f8ae0380-56af-46bc-8d08-9a31dc0fc193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316b26d0-6178-4b02-8207-e910af024af2", "tag": "b8ccdcb7-b2f1-4bf6-ad93-0a6747cda292"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:20:55.255120 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-5b8c4b2f-a2e5-4ae6-bd2a-ebfcb77d4541 req-f8ae0380-56af-46bc-8d08-9a31dc0fc193 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:55.256768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-5b8c4b2f-a2e5-4ae6-bd2a-ebfcb77d4541 req-f8ae0380-56af-46bc-8d08-9a31dc0fc193 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:55.257413 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-5b8c4b2f-a2e5-4ae6-bd2a-ebfcb77d4541 req-f8ae0380-56af-46bc-8d08-9a31dc0fc193 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:55.346558 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-5b8c4b2f-a2e5-4ae6-bd2a-ebfcb77d4541 req-f8ae0380-56af-46bc-8d08-9a31dc0fc193 service nova] Creating event network-changed:b8ccdcb7-b2f1-4bf6-ad93-0a6747cda292 for instance 316b26d0-6178-4b02-8207-e910af024af2 on hv-cinder-83602 Aug 18 12:20:55.367253 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-5b8c4b2f-a2e5-4ae6-bd2a-ebfcb77d4541 req-f8ae0380-56af-46bc-8d08-9a31dc0fc193 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135170 Aug 18 12:20:55.374921 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 36/67] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:20:55.391473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a4fa4c1b-7a03-4e3b-a296-0a4e55086498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:55.400065 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a4fa4c1b-7a03-4e3b-a296-0a4e55086498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:55.417465 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a4fa4c1b-7a03-4e3b-a296-0a4e55086498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:55.421418 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a4fa4c1b-7a03-4e3b-a296-0a4e55086498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:55.428258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a4fa4c1b-7a03-4e3b-a296-0a4e55086498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:55.428258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a4fa4c1b-7a03-4e3b-a296-0a4e55086498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:55.428258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a4fa4c1b-7a03-4e3b-a296-0a4e55086498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:55.432972 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a4fa4c1b-7a03-4e3b-a296-0a4e55086498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:55.837215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8713714a-c482-4f8d-857a-e34062d062e8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:55.845840 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8713714a-c482-4f8d-857a-e34062d062e8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.979100 Aug 18 12:20:55.846420 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 32/68] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:54 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:55.903137 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a4fa4c1b-7a03-4e3b-a296-0a4e55086498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:55.914377 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a4fa4c1b-7a03-4e3b-a296-0a4e55086498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.537095 Aug 18 12:20:55.927551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 37/69] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:55 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:55.944976 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-26ca649e-5833-42c0-ad77-b6724d942360 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:55.944976 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-26ca649e-5833-42c0-ad77-b6724d942360 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:55.956371 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-26ca649e-5833-42c0-ad77-b6724d942360 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:55.960135 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-26ca649e-5833-42c0-ad77-b6724d942360 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:55.960606 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-26ca649e-5833-42c0-ad77-b6724d942360 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:55.966746 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-26ca649e-5833-42c0-ad77-b6724d942360 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:55.968892 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-26ca649e-5833-42c0-ad77-b6724d942360 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:55.969344 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-26ca649e-5833-42c0-ad77-b6724d942360 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:56.479694 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-07d3e54a-07ff-46a8-8f38-3f1b3a5f2659 req-e056e6d0-2fa0-4f5b-9f71-8500e192fa7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c885cd6b-b031-4755-bfc7-f597267136dd", "tag": "0352601f-0b74-4242-ba88-196fa16f9887"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:20:56.532042 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-07d3e54a-07ff-46a8-8f38-3f1b3a5f2659 req-e056e6d0-2fa0-4f5b-9f71-8500e192fa7f service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:56.536980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-07d3e54a-07ff-46a8-8f38-3f1b3a5f2659 req-e056e6d0-2fa0-4f5b-9f71-8500e192fa7f service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:56.538357 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-07d3e54a-07ff-46a8-8f38-3f1b3a5f2659 req-e056e6d0-2fa0-4f5b-9f71-8500e192fa7f service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:56.563021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-26ca649e-5833-42c0-ad77-b6724d942360 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:56.575911 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-26ca649e-5833-42c0-ad77-b6724d942360 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.638295 Aug 18 12:20:56.576753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 33/70] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:55 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:56.587762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-07d3e54a-07ff-46a8-8f38-3f1b3a5f2659 req-e056e6d0-2fa0-4f5b-9f71-8500e192fa7f service nova] Creating event network-changed:0352601f-0b74-4242-ba88-196fa16f9887 for instance c885cd6b-b031-4755-bfc7-f597267136dd on hv-cinder-83602 Aug 18 12:20:56.595605 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-07d3e54a-07ff-46a8-8f38-3f1b3a5f2659 req-e056e6d0-2fa0-4f5b-9f71-8500e192fa7f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119324 Aug 18 12:20:56.613230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 38/71] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:20:56.869500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6333c3de-0d16-427a-bfa1-9aee05236ab5 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:56.872679 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-6333c3de-0d16-427a-bfa1-9aee05236ab5 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:56.881355 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6333c3de-0d16-427a-bfa1-9aee05236ab5 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:56.882245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6333c3de-0d16-427a-bfa1-9aee05236ab5 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:56.882977 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6333c3de-0d16-427a-bfa1-9aee05236ab5 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:56.884406 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6333c3de-0d16-427a-bfa1-9aee05236ab5 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:56.884860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6333c3de-0d16-427a-bfa1-9aee05236ab5 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:56.885434 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6333c3de-0d16-427a-bfa1-9aee05236ab5 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:56.944228 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ca4216fc-8657-4aa2-b52d-58af7bfeda54 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:56.944918 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ca4216fc-8657-4aa2-b52d-58af7bfeda54 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:56.959082 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca4216fc-8657-4aa2-b52d-58af7bfeda54 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:56.959974 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca4216fc-8657-4aa2-b52d-58af7bfeda54 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:56.960574 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca4216fc-8657-4aa2-b52d-58af7bfeda54 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:56.961482 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca4216fc-8657-4aa2-b52d-58af7bfeda54 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:56.962102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca4216fc-8657-4aa2-b52d-58af7bfeda54 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:56.964721 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca4216fc-8657-4aa2-b52d-58af7bfeda54 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:57.205365 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-6333c3de-0d16-427a-bfa1-9aee05236ab5 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:57.217844 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-6333c3de-0d16-427a-bfa1-9aee05236ab5 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.354381 Aug 18 12:20:57.218680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 34/72] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:56 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:57.564910 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ca4216fc-8657-4aa2-b52d-58af7bfeda54 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:57.573448 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ca4216fc-8657-4aa2-b52d-58af7bfeda54 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.633326 Aug 18 12:20:57.578449 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 39/73] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:56 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:20:57.615773 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0ad61487-3000-42f3-afea-47215e61ea49 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:57.617178 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0ad61487-3000-42f3-afea-47215e61ea49 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:57.626165 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:57.635501 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0ad61487-3000-42f3-afea-47215e61ea49 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:57.636860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0ad61487-3000-42f3-afea-47215e61ea49 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:57.638570 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0ad61487-3000-42f3-afea-47215e61ea49 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:57.640048 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0ad61487-3000-42f3-afea-47215e61ea49 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:57.640736 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0ad61487-3000-42f3-afea-47215e61ea49 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:57.641386 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0ad61487-3000-42f3-afea-47215e61ea49 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:57.887765 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0ad61487-3000-42f3-afea-47215e61ea49 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:57.909079 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0ad61487-3000-42f3-afea-47215e61ea49 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.308837 Aug 18 12:20:57.911392 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 35/74] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:57 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:58.238371 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-733c3faa-650e-4ae5-8c71-f0d640d1217a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:58.238989 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-733c3faa-650e-4ae5-8c71-f0d640d1217a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:58.241084 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:20:58.247682 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-733c3faa-650e-4ae5-8c71-f0d640d1217a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:58.248531 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-733c3faa-650e-4ae5-8c71-f0d640d1217a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:58.249121 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-733c3faa-650e-4ae5-8c71-f0d640d1217a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:58.250170 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-733c3faa-650e-4ae5-8c71-f0d640d1217a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:58.250911 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-733c3faa-650e-4ae5-8c71-f0d640d1217a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:58.251563 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-733c3faa-650e-4ae5-8c71-f0d640d1217a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:58.517320 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-733c3faa-650e-4ae5-8c71-f0d640d1217a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:58.528328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-733c3faa-650e-4ae5-8c71-f0d640d1217a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.293672 Aug 18 12:20:58.529769 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 40/75] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:58 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:58.608652 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f6c53e46-fe4e-449f-abc5-316eefc624fe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:58.609607 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f6c53e46-fe4e-449f-abc5-316eefc624fe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:58.617753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6c53e46-fe4e-449f-abc5-316eefc624fe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:58.618780 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6c53e46-fe4e-449f-abc5-316eefc624fe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:58.619549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6c53e46-fe4e-449f-abc5-316eefc624fe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:58.633542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6c53e46-fe4e-449f-abc5-316eefc624fe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:58.633542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6c53e46-fe4e-449f-abc5-316eefc624fe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:58.633542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6c53e46-fe4e-449f-abc5-316eefc624fe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:58.934768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0d9d253d-55bb-458c-b267-83258e51b9c6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:58.936724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0d9d253d-55bb-458c-b267-83258e51b9c6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:58.969976 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d9d253d-55bb-458c-b267-83258e51b9c6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:58.974164 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d9d253d-55bb-458c-b267-83258e51b9c6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:58.978041 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d9d253d-55bb-458c-b267-83258e51b9c6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:58.980257 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d9d253d-55bb-458c-b267-83258e51b9c6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:58.983406 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d9d253d-55bb-458c-b267-83258e51b9c6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:58.987151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d9d253d-55bb-458c-b267-83258e51b9c6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:59.112158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f6c53e46-fe4e-449f-abc5-316eefc624fe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:59.124354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f6c53e46-fe4e-449f-abc5-316eefc624fe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.521018 Aug 18 12:20:59.124962 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 36/76] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:58 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:20:59.292150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0d9d253d-55bb-458c-b267-83258e51b9c6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:59.308911 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0d9d253d-55bb-458c-b267-83258e51b9c6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.378510 Aug 18 12:20:59.308911 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 41/77] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:58 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:20:59.554219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b8cdd34b-0165-4700-bfb0-7a79ce0132f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:20:59.554896 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b8cdd34b-0165-4700-bfb0-7a79ce0132f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:20:59.571637 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8cdd34b-0165-4700-bfb0-7a79ce0132f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:59.573558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8cdd34b-0165-4700-bfb0-7a79ce0132f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:59.574095 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8cdd34b-0165-4700-bfb0-7a79ce0132f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:59.575890 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8cdd34b-0165-4700-bfb0-7a79ce0132f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:20:59.576345 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8cdd34b-0165-4700-bfb0-7a79ce0132f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:20:59.576772 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8cdd34b-0165-4700-bfb0-7a79ce0132f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:20:59.828215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b8cdd34b-0165-4700-bfb0-7a79ce0132f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:20:59.862007 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b8cdd34b-0165-4700-bfb0-7a79ce0132f6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.312192 Aug 18 12:20:59.863624 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 37/78] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:20:59 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:00.151369 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-283cb83a-ef5e-45b5-95a4-466bb2679d2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:00.152111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-283cb83a-ef5e-45b5-95a4-466bb2679d2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:00.185802 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-283cb83a-ef5e-45b5-95a4-466bb2679d2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:00.187698 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-283cb83a-ef5e-45b5-95a4-466bb2679d2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:00.189264 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-283cb83a-ef5e-45b5-95a4-466bb2679d2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:00.192669 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-283cb83a-ef5e-45b5-95a4-466bb2679d2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:00.197202 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-283cb83a-ef5e-45b5-95a4-466bb2679d2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:00.197782 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-283cb83a-ef5e-45b5-95a4-466bb2679d2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:00.334156 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f779bb63-96e9-46cf-a044-926744ca12d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:00.334770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f779bb63-96e9-46cf-a044-926744ca12d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:00.345169 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f779bb63-96e9-46cf-a044-926744ca12d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:00.348100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f779bb63-96e9-46cf-a044-926744ca12d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:00.348100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f779bb63-96e9-46cf-a044-926744ca12d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:00.348100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f779bb63-96e9-46cf-a044-926744ca12d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:00.348100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f779bb63-96e9-46cf-a044-926744ca12d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:00.358492 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f779bb63-96e9-46cf-a044-926744ca12d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:00.514470 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-283cb83a-ef5e-45b5-95a4-466bb2679d2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:00.523288 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-283cb83a-ef5e-45b5-95a4-466bb2679d2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.380967 Aug 18 12:21:00.530987 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 42/79] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:00 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:00.668894 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f779bb63-96e9-46cf-a044-926744ca12d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:00.688495 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f779bb63-96e9-46cf-a044-926744ca12d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.358692 Aug 18 12:21:00.697564 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 38/80] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:00 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:00.888014 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-eb443628-28a6-4d22-af57-8fd7a7ea3642 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:00.889629 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-eb443628-28a6-4d22-af57-8fd7a7ea3642 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:00.900645 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb443628-28a6-4d22-af57-8fd7a7ea3642 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:00.901561 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb443628-28a6-4d22-af57-8fd7a7ea3642 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:00.902444 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb443628-28a6-4d22-af57-8fd7a7ea3642 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:00.903697 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb443628-28a6-4d22-af57-8fd7a7ea3642 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:00.904389 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb443628-28a6-4d22-af57-8fd7a7ea3642 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:00.905009 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb443628-28a6-4d22-af57-8fd7a7ea3642 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:01.085150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-eb443628-28a6-4d22-af57-8fd7a7ea3642 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:01.085150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-eb443628-28a6-4d22-af57-8fd7a7ea3642 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.199325 Aug 18 12:21:01.085150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 43/81] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:00 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:01.548575 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b5c868c2-0392-4e9a-b63e-896897bbb044 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:01.549214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b5c868c2-0392-4e9a-b63e-896897bbb044 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:01.555314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5c868c2-0392-4e9a-b63e-896897bbb044 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:01.555819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5c868c2-0392-4e9a-b63e-896897bbb044 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:01.556295 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5c868c2-0392-4e9a-b63e-896897bbb044 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:01.556954 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5c868c2-0392-4e9a-b63e-896897bbb044 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:01.557397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5c868c2-0392-4e9a-b63e-896897bbb044 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:01.557808 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5c868c2-0392-4e9a-b63e-896897bbb044 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:01.708231 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b5c868c2-0392-4e9a-b63e-896897bbb044 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:01.723327 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-fb515a47-37b3-41ba-a573-ababc73aef71 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:01.723971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-fb515a47-37b3-41ba-a573-ababc73aef71 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:01.727358 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b5c868c2-0392-4e9a-b63e-896897bbb044 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.173853 Aug 18 12:21:01.728035 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 39/82] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:01 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:01.737799 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fb515a47-37b3-41ba-a573-ababc73aef71 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:01.739291 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fb515a47-37b3-41ba-a573-ababc73aef71 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:01.740297 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fb515a47-37b3-41ba-a573-ababc73aef71 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:01.741304 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fb515a47-37b3-41ba-a573-ababc73aef71 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:01.741896 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fb515a47-37b3-41ba-a573-ababc73aef71 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:01.742557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fb515a47-37b3-41ba-a573-ababc73aef71 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:01.927361 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-fb515a47-37b3-41ba-a573-ababc73aef71 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:01.936176 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-fb515a47-37b3-41ba-a573-ababc73aef71 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.217153 Aug 18 12:21:01.943456 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 44/83] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:01 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:02.102751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0293023e-75de-450e-8554-81b50cea5605 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:02.103352 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0293023e-75de-450e-8554-81b50cea5605 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:02.109442 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0293023e-75de-450e-8554-81b50cea5605 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:02.110029 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0293023e-75de-450e-8554-81b50cea5605 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:02.110464 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0293023e-75de-450e-8554-81b50cea5605 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:02.111144 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0293023e-75de-450e-8554-81b50cea5605 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:02.111657 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0293023e-75de-450e-8554-81b50cea5605 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:02.112072 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0293023e-75de-450e-8554-81b50cea5605 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:02.258855 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0293023e-75de-450e-8554-81b50cea5605 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:02.268899 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0293023e-75de-450e-8554-81b50cea5605 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.170121 Aug 18 12:21:02.269729 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 40/84] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:02 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:02.748921 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-23b5ce94-0fa9-4ef7-8db8-6caffba24cd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:02.749531 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-23b5ce94-0fa9-4ef7-8db8-6caffba24cd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:02.755322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23b5ce94-0fa9-4ef7-8db8-6caffba24cd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:02.755834 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23b5ce94-0fa9-4ef7-8db8-6caffba24cd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:02.756261 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23b5ce94-0fa9-4ef7-8db8-6caffba24cd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:02.756943 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23b5ce94-0fa9-4ef7-8db8-6caffba24cd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:02.757387 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23b5ce94-0fa9-4ef7-8db8-6caffba24cd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:02.757805 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23b5ce94-0fa9-4ef7-8db8-6caffba24cd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:02.899577 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-23b5ce94-0fa9-4ef7-8db8-6caffba24cd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:02.908746 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-23b5ce94-0fa9-4ef7-8db8-6caffba24cd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.164343 Aug 18 12:21:02.909359 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 45/85] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:02 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:02.957039 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-80317924-30e0-488a-82a4-c65ec4531515 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:02.957661 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-80317924-30e0-488a-82a4-c65ec4531515 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:02.964060 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80317924-30e0-488a-82a4-c65ec4531515 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:02.964568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80317924-30e0-488a-82a4-c65ec4531515 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:02.964982 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80317924-30e0-488a-82a4-c65ec4531515 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:02.965858 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80317924-30e0-488a-82a4-c65ec4531515 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:02.967199 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80317924-30e0-488a-82a4-c65ec4531515 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:02.970613 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80317924-30e0-488a-82a4-c65ec4531515 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:03.116723 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-80317924-30e0-488a-82a4-c65ec4531515 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:03.126420 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-80317924-30e0-488a-82a4-c65ec4531515 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.173119 Aug 18 12:21:03.127074 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 41/86] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:02 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:03.291436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b9903f6c-67fe-4303-bcdb-1804c7aec8a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:03.292638 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b9903f6c-67fe-4303-bcdb-1804c7aec8a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:03.299783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:03.301589 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9903f6c-67fe-4303-bcdb-1804c7aec8a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:03.302305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9903f6c-67fe-4303-bcdb-1804c7aec8a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:03.303342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9903f6c-67fe-4303-bcdb-1804c7aec8a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:03.304666 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9903f6c-67fe-4303-bcdb-1804c7aec8a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:03.305275 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9903f6c-67fe-4303-bcdb-1804c7aec8a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:03.305768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9903f6c-67fe-4303-bcdb-1804c7aec8a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:03.505824 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b9903f6c-67fe-4303-bcdb-1804c7aec8a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:03.505824 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b9903f6c-67fe-4303-bcdb-1804c7aec8a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.205409 Aug 18 12:21:03.505824 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 46/87] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:03 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:03.929617 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d595c23c-1074-4c41-a718-dbf7dc14f0fc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:03.930221 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d595c23c-1074-4c41-a718-dbf7dc14f0fc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:03.936800 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d595c23c-1074-4c41-a718-dbf7dc14f0fc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:03.937331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d595c23c-1074-4c41-a718-dbf7dc14f0fc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:03.937771 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d595c23c-1074-4c41-a718-dbf7dc14f0fc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:03.938460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d595c23c-1074-4c41-a718-dbf7dc14f0fc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:03.938905 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d595c23c-1074-4c41-a718-dbf7dc14f0fc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:03.939381 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d595c23c-1074-4c41-a718-dbf7dc14f0fc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:04.081250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d595c23c-1074-4c41-a718-dbf7dc14f0fc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:04.084324 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d595c23c-1074-4c41-a718-dbf7dc14f0fc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.158425 Aug 18 12:21:04.085084 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 42/88] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:03 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:04.156093 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-fcd9ddec-7c99-469c-bab9-ebd0d3d3aacc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:04.156707 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-fcd9ddec-7c99-469c-bab9-ebd0d3d3aacc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:04.164411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcd9ddec-7c99-469c-bab9-ebd0d3d3aacc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:04.164899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcd9ddec-7c99-469c-bab9-ebd0d3d3aacc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:04.165332 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcd9ddec-7c99-469c-bab9-ebd0d3d3aacc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:04.166030 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcd9ddec-7c99-469c-bab9-ebd0d3d3aacc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:04.166485 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcd9ddec-7c99-469c-bab9-ebd0d3d3aacc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:04.166914 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcd9ddec-7c99-469c-bab9-ebd0d3d3aacc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:04.304875 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-fcd9ddec-7c99-469c-bab9-ebd0d3d3aacc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:04.313940 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-fcd9ddec-7c99-469c-bab9-ebd0d3d3aacc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.162113 Aug 18 12:21:04.318888 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 47/89] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:04 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:04.514199 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-247cc5e1-aa98-46fe-b222-f0e86cf864d3 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:04.515059 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-247cc5e1-aa98-46fe-b222-f0e86cf864d3 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:04.518052 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:04.521733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-247cc5e1-aa98-46fe-b222-f0e86cf864d3 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:04.522218 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-247cc5e1-aa98-46fe-b222-f0e86cf864d3 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:04.522711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-247cc5e1-aa98-46fe-b222-f0e86cf864d3 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:04.523647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-247cc5e1-aa98-46fe-b222-f0e86cf864d3 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:04.524109 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-247cc5e1-aa98-46fe-b222-f0e86cf864d3 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:04.524529 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-247cc5e1-aa98-46fe-b222-f0e86cf864d3 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:04.688622 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-247cc5e1-aa98-46fe-b222-f0e86cf864d3 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:04.696803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-247cc5e1-aa98-46fe-b222-f0e86cf864d3 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.187476 Aug 18 12:21:04.697424 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 43/90] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:04 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:05.104934 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a9b55327-8882-4cbd-9167-7ccef2f35e6d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:05.105545 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a9b55327-8882-4cbd-9167-7ccef2f35e6d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:05.112033 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9b55327-8882-4cbd-9167-7ccef2f35e6d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:05.112513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9b55327-8882-4cbd-9167-7ccef2f35e6d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:05.112949 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9b55327-8882-4cbd-9167-7ccef2f35e6d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:05.113708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9b55327-8882-4cbd-9167-7ccef2f35e6d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:05.114165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9b55327-8882-4cbd-9167-7ccef2f35e6d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:05.114588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9b55327-8882-4cbd-9167-7ccef2f35e6d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:05.290181 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a9b55327-8882-4cbd-9167-7ccef2f35e6d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:05.300698 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a9b55327-8882-4cbd-9167-7ccef2f35e6d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.199472 Aug 18 12:21:05.317833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 48/91] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:05 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:05.335113 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e371b3b6-1167-4282-bf69-6f1b7d882610 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:05.335761 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e371b3b6-1167-4282-bf69-6f1b7d882610 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:05.347103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e371b3b6-1167-4282-bf69-6f1b7d882610 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:05.352387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e371b3b6-1167-4282-bf69-6f1b7d882610 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:05.352387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e371b3b6-1167-4282-bf69-6f1b7d882610 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:05.352387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e371b3b6-1167-4282-bf69-6f1b7d882610 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:05.352387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e371b3b6-1167-4282-bf69-6f1b7d882610 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:05.352814 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e371b3b6-1167-4282-bf69-6f1b7d882610 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:05.495847 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e371b3b6-1167-4282-bf69-6f1b7d882610 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:05.504466 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e371b3b6-1167-4282-bf69-6f1b7d882610 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.173699 Aug 18 12:21:05.505042 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 44/92] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:05 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:05.719808 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-eeb0316d-0f2d-43dc-8447-064ff7d7aa47 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:05.720418 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-eeb0316d-0f2d-43dc-8447-064ff7d7aa47 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:05.726237 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eeb0316d-0f2d-43dc-8447-064ff7d7aa47 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:05.726848 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eeb0316d-0f2d-43dc-8447-064ff7d7aa47 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:05.727130 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eeb0316d-0f2d-43dc-8447-064ff7d7aa47 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:05.727837 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eeb0316d-0f2d-43dc-8447-064ff7d7aa47 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:05.728277 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eeb0316d-0f2d-43dc-8447-064ff7d7aa47 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:05.728694 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eeb0316d-0f2d-43dc-8447-064ff7d7aa47 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:05.867991 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-eeb0316d-0f2d-43dc-8447-064ff7d7aa47 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:05.876481 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-eeb0316d-0f2d-43dc-8447-064ff7d7aa47 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.161024 Aug 18 12:21:05.877057 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 49/93] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:05 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:06.322411 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d90bd3ff-4349-40be-a924-1bc5210dd893 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:06.323295 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d90bd3ff-4349-40be-a924-1bc5210dd893 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:06.331651 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d90bd3ff-4349-40be-a924-1bc5210dd893 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:06.332210 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d90bd3ff-4349-40be-a924-1bc5210dd893 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:06.332951 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d90bd3ff-4349-40be-a924-1bc5210dd893 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:06.333828 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d90bd3ff-4349-40be-a924-1bc5210dd893 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:06.334471 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d90bd3ff-4349-40be-a924-1bc5210dd893 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:06.334897 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d90bd3ff-4349-40be-a924-1bc5210dd893 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:06.487244 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d90bd3ff-4349-40be-a924-1bc5210dd893 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:06.494659 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d90bd3ff-4349-40be-a924-1bc5210dd893 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.176464 Aug 18 12:21:06.495224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 45/94] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:06 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:06.525553 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3fb767f3-1255-47be-b91a-94925b8a2e85 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:06.526169 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3fb767f3-1255-47be-b91a-94925b8a2e85 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:06.532855 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fb767f3-1255-47be-b91a-94925b8a2e85 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:06.533340 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fb767f3-1255-47be-b91a-94925b8a2e85 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:06.533773 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fb767f3-1255-47be-b91a-94925b8a2e85 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:06.534464 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fb767f3-1255-47be-b91a-94925b8a2e85 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:06.534916 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fb767f3-1255-47be-b91a-94925b8a2e85 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:06.535339 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fb767f3-1255-47be-b91a-94925b8a2e85 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:06.673350 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3fb767f3-1255-47be-b91a-94925b8a2e85 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:06.682575 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3fb767f3-1255-47be-b91a-94925b8a2e85 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.160611 Aug 18 12:21:06.683403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 50/95] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:06 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:06.897648 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f574b1e3-61cc-4812-81e9-58660b5a37dc tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:06.898265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f574b1e3-61cc-4812-81e9-58660b5a37dc tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:06.904934 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f574b1e3-61cc-4812-81e9-58660b5a37dc tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:06.905430 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f574b1e3-61cc-4812-81e9-58660b5a37dc tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:06.905864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f574b1e3-61cc-4812-81e9-58660b5a37dc tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:06.906568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f574b1e3-61cc-4812-81e9-58660b5a37dc tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:06.907012 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f574b1e3-61cc-4812-81e9-58660b5a37dc tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:06.907438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f574b1e3-61cc-4812-81e9-58660b5a37dc tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:07.050479 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f574b1e3-61cc-4812-81e9-58660b5a37dc tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:07.058405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f574b1e3-61cc-4812-81e9-58660b5a37dc tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.164726 Aug 18 12:21:07.058974 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 46/96] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:06 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:07.517243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-088eeb8d-b2c3-4ed3-b610-24d9ffcebcd4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:07.521181 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-088eeb8d-b2c3-4ed3-b610-24d9ffcebcd4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:07.525502 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-088eeb8d-b2c3-4ed3-b610-24d9ffcebcd4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:07.526174 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-088eeb8d-b2c3-4ed3-b610-24d9ffcebcd4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:07.526821 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-088eeb8d-b2c3-4ed3-b610-24d9ffcebcd4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:07.527350 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-088eeb8d-b2c3-4ed3-b610-24d9ffcebcd4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:07.528285 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-088eeb8d-b2c3-4ed3-b610-24d9ffcebcd4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:07.529226 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-088eeb8d-b2c3-4ed3-b610-24d9ffcebcd4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:07.725206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-de692f13-4f02-41c6-aa99-28263cf7fd00 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:07.725206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-de692f13-4f02-41c6-aa99-28263cf7fd00 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:07.746200 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-de692f13-4f02-41c6-aa99-28263cf7fd00 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:07.746732 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-de692f13-4f02-41c6-aa99-28263cf7fd00 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:07.747167 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-de692f13-4f02-41c6-aa99-28263cf7fd00 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:07.757770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-de692f13-4f02-41c6-aa99-28263cf7fd00 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:07.757770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-de692f13-4f02-41c6-aa99-28263cf7fd00 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:07.757770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-de692f13-4f02-41c6-aa99-28263cf7fd00 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:07.797998 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-088eeb8d-b2c3-4ed3-b610-24d9ffcebcd4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:07.811175 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-088eeb8d-b2c3-4ed3-b610-24d9ffcebcd4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.298751 Aug 18 12:21:07.826332 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 51/97] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:07 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:08.008640 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-de692f13-4f02-41c6-aa99-28263cf7fd00 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:08.012872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=100 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:08.019379 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-de692f13-4f02-41c6-aa99-28263cf7fd00 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.310963 Aug 18 12:21:08.020503 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 47/98] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:07 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:08.080008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cfe1549f-5069-4306-8b84-3e0a5b901d8e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:08.080624 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-cfe1549f-5069-4306-8b84-3e0a5b901d8e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:08.088633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-28fc5de4-c7c9-4bca-bb66-26cd2cb9177c req-7c945bef-359f-4875-9061-8db386ef6b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d584dbe7-cf44-4182-8ee3-3a240b0a8f37", "name": "network-vif-plugged", "status": "completed", "tag": "d8111269-50cb-47be-baad-3ecc1d3bf9f9"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:08.098214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfe1549f-5069-4306-8b84-3e0a5b901d8e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:08.098705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfe1549f-5069-4306-8b84-3e0a5b901d8e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:08.102749 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-28fc5de4-c7c9-4bca-bb66-26cd2cb9177c req-7c945bef-359f-4875-9061-8db386ef6b38 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:08.103613 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfe1549f-5069-4306-8b84-3e0a5b901d8e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:08.104557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfe1549f-5069-4306-8b84-3e0a5b901d8e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:08.105178 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfe1549f-5069-4306-8b84-3e0a5b901d8e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:08.105757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfe1549f-5069-4306-8b84-3e0a5b901d8e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:08.106510 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-28fc5de4-c7c9-4bca-bb66-26cd2cb9177c req-7c945bef-359f-4875-9061-8db386ef6b38 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:08.111614 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-28fc5de4-c7c9-4bca-bb66-26cd2cb9177c req-7c945bef-359f-4875-9061-8db386ef6b38 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:08.124020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=100 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:08.127723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-28fc5de4-c7c9-4bca-bb66-26cd2cb9177c req-7c945bef-359f-4875-9061-8db386ef6b38 service nova] Creating event network-vif-plugged:d8111269-50cb-47be-baad-3ecc1d3bf9f9 for instance d584dbe7-cf44-4182-8ee3-3a240b0a8f37 on hv-cinder-83602 Aug 18 12:21:08.132437 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-28fc5de4-c7c9-4bca-bb66-26cd2cb9177c req-7c945bef-359f-4875-9061-8db386ef6b38 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122137 Aug 18 12:21:08.133727 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 52/99] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:21:08.310409 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cfe1549f-5069-4306-8b84-3e0a5b901d8e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:08.317109 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cfe1549f-5069-4306-8b84-3e0a5b901d8e tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.241510 Aug 18 12:21:08.318249 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 48/100] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:08 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:08.837356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f0a2b2be-304f-45be-99fa-a2458c93f209 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:08.838261 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f0a2b2be-304f-45be-99fa-a2458c93f209 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:08.867947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f0a2b2be-304f-45be-99fa-a2458c93f209 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:08.868460 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f0a2b2be-304f-45be-99fa-a2458c93f209 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:08.868902 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f0a2b2be-304f-45be-99fa-a2458c93f209 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:08.869619 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f0a2b2be-304f-45be-99fa-a2458c93f209 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:08.870257 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f0a2b2be-304f-45be-99fa-a2458c93f209 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:08.870687 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f0a2b2be-304f-45be-99fa-a2458c93f209 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:09.044112 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b471ecc5-fdfa-423b-b5cc-c822e1d10d55 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:09.048239 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b471ecc5-fdfa-423b-b5cc-c822e1d10d55 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:09.059123 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b471ecc5-fdfa-423b-b5cc-c822e1d10d55 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:09.060365 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b471ecc5-fdfa-423b-b5cc-c822e1d10d55 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:09.061794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b471ecc5-fdfa-423b-b5cc-c822e1d10d55 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:09.062905 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b471ecc5-fdfa-423b-b5cc-c822e1d10d55 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:09.063768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f0a2b2be-304f-45be-99fa-a2458c93f209 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:09.064294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b471ecc5-fdfa-423b-b5cc-c822e1d10d55 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:09.065439 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b471ecc5-fdfa-423b-b5cc-c822e1d10d55 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:09.071034 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f0a2b2be-304f-45be-99fa-a2458c93f209 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.240009 Aug 18 12:21:09.074263 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 53/101] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:08 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:09.219548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b471ecc5-fdfa-423b-b5cc-c822e1d10d55 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:09.227373 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b471ecc5-fdfa-423b-b5cc-c822e1d10d55 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.189651 Aug 18 12:21:09.228096 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 49/102] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:09 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:09.339409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-97226d83-ccc0-428c-87bc-478d44c09fd2 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:09.340227 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-97226d83-ccc0-428c-87bc-478d44c09fd2 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:09.349070 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97226d83-ccc0-428c-87bc-478d44c09fd2 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:09.349666 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97226d83-ccc0-428c-87bc-478d44c09fd2 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:09.351285 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97226d83-ccc0-428c-87bc-478d44c09fd2 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:09.352272 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97226d83-ccc0-428c-87bc-478d44c09fd2 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:09.353602 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97226d83-ccc0-428c-87bc-478d44c09fd2 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:09.354682 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97226d83-ccc0-428c-87bc-478d44c09fd2 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:09.495099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-97226d83-ccc0-428c-87bc-478d44c09fd2 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:09.503056 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-97226d83-ccc0-428c-87bc-478d44c09fd2 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.168723 Aug 18 12:21:09.503638 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 54/103] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:09 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:10.096297 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-72e551c7-9085-455e-b20a-fd5603e7806f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:10.096297 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-72e551c7-9085-455e-b20a-fd5603e7806f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:10.101367 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72e551c7-9085-455e-b20a-fd5603e7806f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:10.101873 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72e551c7-9085-455e-b20a-fd5603e7806f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:10.102638 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72e551c7-9085-455e-b20a-fd5603e7806f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:10.103549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72e551c7-9085-455e-b20a-fd5603e7806f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:10.104008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72e551c7-9085-455e-b20a-fd5603e7806f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:10.104437 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72e551c7-9085-455e-b20a-fd5603e7806f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:10.250423 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f84bb314-5b89-4516-8cc9-d7b735e1c006 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:10.251546 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f84bb314-5b89-4516-8cc9-d7b735e1c006 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:10.264917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f84bb314-5b89-4516-8cc9-d7b735e1c006 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:10.264917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f84bb314-5b89-4516-8cc9-d7b735e1c006 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:10.264917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f84bb314-5b89-4516-8cc9-d7b735e1c006 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:10.264917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f84bb314-5b89-4516-8cc9-d7b735e1c006 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:10.265218 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f84bb314-5b89-4516-8cc9-d7b735e1c006 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:10.265218 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f84bb314-5b89-4516-8cc9-d7b735e1c006 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:10.311219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-72e551c7-9085-455e-b20a-fd5603e7806f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:10.319453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-72e551c7-9085-455e-b20a-fd5603e7806f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.229330 Aug 18 12:21:10.346717 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 50/104] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:10 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:10.507633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f84bb314-5b89-4516-8cc9-d7b735e1c006 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:10.523032 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f84bb314-5b89-4516-8cc9-d7b735e1c006 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.278231 Aug 18 12:21:10.529222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-85fdb43a-af37-4c1f-b207-f1ed889b4f48 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:10.530124 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-85fdb43a-af37-4c1f-b207-f1ed889b4f48 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:10.537929 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 55/105] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:10 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:10.544178 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fdb43a-af37-4c1f-b207-f1ed889b4f48 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:10.551354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fdb43a-af37-4c1f-b207-f1ed889b4f48 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:10.551354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fdb43a-af37-4c1f-b207-f1ed889b4f48 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:10.551354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fdb43a-af37-4c1f-b207-f1ed889b4f48 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:10.551354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fdb43a-af37-4c1f-b207-f1ed889b4f48 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:10.552141 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fdb43a-af37-4c1f-b207-f1ed889b4f48 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:10.703193 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-85fdb43a-af37-4c1f-b207-f1ed889b4f48 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:10.711616 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-85fdb43a-af37-4c1f-b207-f1ed889b4f48 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.189034 Aug 18 12:21:10.712191 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 51/106] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:10 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:11.340483 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-79535a06-53cc-46f6-aedc-d70407889bd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:11.341218 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-79535a06-53cc-46f6-aedc-d70407889bd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:11.347366 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-79535a06-53cc-46f6-aedc-d70407889bd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:11.347939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-79535a06-53cc-46f6-aedc-d70407889bd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:11.348441 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-79535a06-53cc-46f6-aedc-d70407889bd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:11.349087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-79535a06-53cc-46f6-aedc-d70407889bd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:11.349566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-79535a06-53cc-46f6-aedc-d70407889bd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:11.350008 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-79535a06-53cc-46f6-aedc-d70407889bd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:11.492796 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-79535a06-53cc-46f6-aedc-d70407889bd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:11.503645 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-79535a06-53cc-46f6-aedc-d70407889bd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.165466 Aug 18 12:21:11.503645 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 56/107] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:11 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:11.544944 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-50ab7c07-2930-4001-9300-b479c681bf37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:11.545513 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-50ab7c07-2930-4001-9300-b479c681bf37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:11.552169 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-50ab7c07-2930-4001-9300-b479c681bf37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:11.561251 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-50ab7c07-2930-4001-9300-b479c681bf37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:11.561251 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-50ab7c07-2930-4001-9300-b479c681bf37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:11.561251 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-50ab7c07-2930-4001-9300-b479c681bf37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:11.561251 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-50ab7c07-2930-4001-9300-b479c681bf37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:11.562264 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-50ab7c07-2930-4001-9300-b479c681bf37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:11.717825 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-50ab7c07-2930-4001-9300-b479c681bf37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:11.727200 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-50ab7c07-2930-4001-9300-b479c681bf37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.186200 Aug 18 12:21:11.729463 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 52/108] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:11 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:11.732776 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c995ede9-5fb2-4c74-af43-09bf24a167e0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:11.735371 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c995ede9-5fb2-4c74-af43-09bf24a167e0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:11.751294 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c995ede9-5fb2-4c74-af43-09bf24a167e0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:11.752211 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c995ede9-5fb2-4c74-af43-09bf24a167e0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:11.752798 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c995ede9-5fb2-4c74-af43-09bf24a167e0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:11.753645 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c995ede9-5fb2-4c74-af43-09bf24a167e0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:11.757067 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c995ede9-5fb2-4c74-af43-09bf24a167e0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:11.757699 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c995ede9-5fb2-4c74-af43-09bf24a167e0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:12.000766 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c995ede9-5fb2-4c74-af43-09bf24a167e0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:12.009895 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c995ede9-5fb2-4c74-af43-09bf24a167e0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.281075 Aug 18 12:21:12.024049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 57/109] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:11 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:12.522655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a1f61dab-3995-41be-aef5-b3758f7c2137 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:12.523254 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a1f61dab-3995-41be-aef5-b3758f7c2137 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:12.531076 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a1f61dab-3995-41be-aef5-b3758f7c2137 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:12.532029 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a1f61dab-3995-41be-aef5-b3758f7c2137 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:12.532590 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a1f61dab-3995-41be-aef5-b3758f7c2137 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:12.533516 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a1f61dab-3995-41be-aef5-b3758f7c2137 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:12.533975 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a1f61dab-3995-41be-aef5-b3758f7c2137 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:12.534462 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a1f61dab-3995-41be-aef5-b3758f7c2137 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:12.707333 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a1f61dab-3995-41be-aef5-b3758f7c2137 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:12.717934 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a1f61dab-3995-41be-aef5-b3758f7c2137 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.199209 Aug 18 12:21:12.718687 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 53/110] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:12 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:12.750989 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-32f3a54f-dd7e-4528-9bea-70c72ab6044b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:12.751628 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-32f3a54f-dd7e-4528-9bea-70c72ab6044b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:12.757893 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32f3a54f-dd7e-4528-9bea-70c72ab6044b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:12.758381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32f3a54f-dd7e-4528-9bea-70c72ab6044b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:12.758817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32f3a54f-dd7e-4528-9bea-70c72ab6044b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:12.759545 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32f3a54f-dd7e-4528-9bea-70c72ab6044b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:12.760001 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32f3a54f-dd7e-4528-9bea-70c72ab6044b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:12.760421 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32f3a54f-dd7e-4528-9bea-70c72ab6044b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:12.961637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-32f3a54f-dd7e-4528-9bea-70c72ab6044b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:12.969864 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-32f3a54f-dd7e-4528-9bea-70c72ab6044b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.223090 Aug 18 12:21:12.970602 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 58/111] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:12 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:13.033048 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-189a32cf-77d1-4920-b92a-f0e33ea4f9dd tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:13.033048 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-189a32cf-77d1-4920-b92a-f0e33ea4f9dd tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:13.039261 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-189a32cf-77d1-4920-b92a-f0e33ea4f9dd tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:13.039769 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-189a32cf-77d1-4920-b92a-f0e33ea4f9dd tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:13.040197 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-189a32cf-77d1-4920-b92a-f0e33ea4f9dd tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:13.041375 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-189a32cf-77d1-4920-b92a-f0e33ea4f9dd tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:13.041825 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-189a32cf-77d1-4920-b92a-f0e33ea4f9dd tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:13.042375 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-189a32cf-77d1-4920-b92a-f0e33ea4f9dd tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:13.195909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-189a32cf-77d1-4920-b92a-f0e33ea4f9dd tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:13.204109 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-189a32cf-77d1-4920-b92a-f0e33ea4f9dd tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.176344 Aug 18 12:21:13.204681 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 54/112] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:13 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:13.751409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-eefabfd5-d6ea-404d-974b-6713fe5c6db9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:13.754618 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-eefabfd5-d6ea-404d-974b-6713fe5c6db9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:13.763919 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eefabfd5-d6ea-404d-974b-6713fe5c6db9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:13.770413 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eefabfd5-d6ea-404d-974b-6713fe5c6db9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:13.771699 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eefabfd5-d6ea-404d-974b-6713fe5c6db9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:13.773760 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eefabfd5-d6ea-404d-974b-6713fe5c6db9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:13.775682 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eefabfd5-d6ea-404d-974b-6713fe5c6db9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:13.777005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eefabfd5-d6ea-404d-974b-6713fe5c6db9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:13.992466 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-55dc091d-7877-4214-9365-464655f91b4c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:13.994203 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-55dc091d-7877-4214-9365-464655f91b4c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:13.996357 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-eefabfd5-d6ea-404d-974b-6713fe5c6db9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:14.009548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-55dc091d-7877-4214-9365-464655f91b4c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:14.010084 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-55dc091d-7877-4214-9365-464655f91b4c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:14.010528 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-55dc091d-7877-4214-9365-464655f91b4c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:14.011228 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-55dc091d-7877-4214-9365-464655f91b4c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:14.011904 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-55dc091d-7877-4214-9365-464655f91b4c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:14.012329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-55dc091d-7877-4214-9365-464655f91b4c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:14.017448 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-eefabfd5-d6ea-404d-974b-6713fe5c6db9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.280070 Aug 18 12:21:14.032704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 59/113] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:13 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:14.220974 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-55dc091d-7877-4214-9365-464655f91b4c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:14.227202 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-bcaec584-a691-41c6-8652-45c532b6f742 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:14.227893 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-bcaec584-a691-41c6-8652-45c532b6f742 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:14.235667 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bcaec584-a691-41c6-8652-45c532b6f742 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:14.236158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bcaec584-a691-41c6-8652-45c532b6f742 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:14.236593 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bcaec584-a691-41c6-8652-45c532b6f742 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:14.237297 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bcaec584-a691-41c6-8652-45c532b6f742 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:14.237744 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bcaec584-a691-41c6-8652-45c532b6f742 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:14.238164 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bcaec584-a691-41c6-8652-45c532b6f742 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:14.243749 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-55dc091d-7877-4214-9365-464655f91b4c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.255051 Aug 18 12:21:14.244898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 55/114] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:13 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:14.432805 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bcaec584-a691-41c6-8652-45c532b6f742 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:14.440927 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-bcaec584-a691-41c6-8652-45c532b6f742 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.218507 Aug 18 12:21:14.442120 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 60/115] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:14 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:15.046451 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a40b9c7c-bc73-457d-92ad-e045b2886a81 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:15.048271 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a40b9c7c-bc73-457d-92ad-e045b2886a81 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:15.056778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a40b9c7c-bc73-457d-92ad-e045b2886a81 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:15.057372 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a40b9c7c-bc73-457d-92ad-e045b2886a81 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:15.058824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a40b9c7c-bc73-457d-92ad-e045b2886a81 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:15.059643 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a40b9c7c-bc73-457d-92ad-e045b2886a81 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:15.065251 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a40b9c7c-bc73-457d-92ad-e045b2886a81 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:15.066435 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a40b9c7c-bc73-457d-92ad-e045b2886a81 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:15.218975 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a40b9c7c-bc73-457d-92ad-e045b2886a81 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:15.224264 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a40b9c7c-bc73-457d-92ad-e045b2886a81 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1322 microversion: 2.1 time: 0.183070 Aug 18 12:21:15.224853 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 56/116] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:15 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:15.267913 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4404a7d6-c197-482d-a41b-75f82cd54747 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:15.269160 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4404a7d6-c197-482d-a41b-75f82cd54747 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:15.282163 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4404a7d6-c197-482d-a41b-75f82cd54747 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:15.282163 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4404a7d6-c197-482d-a41b-75f82cd54747 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:15.282163 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4404a7d6-c197-482d-a41b-75f82cd54747 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:15.282163 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4404a7d6-c197-482d-a41b-75f82cd54747 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:15.282625 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4404a7d6-c197-482d-a41b-75f82cd54747 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:15.282625 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4404a7d6-c197-482d-a41b-75f82cd54747 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:15.467098 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4404a7d6-c197-482d-a41b-75f82cd54747 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:15.470604 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-87d1ad10-1c5d-4aaa-8184-5ee5c4fec9fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:15.471279 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-87d1ad10-1c5d-4aaa-8184-5ee5c4fec9fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:15.475542 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4404a7d6-c197-482d-a41b-75f82cd54747 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.213023 Aug 18 12:21:15.476045 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 61/117] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:15 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:15.483707 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-87d1ad10-1c5d-4aaa-8184-5ee5c4fec9fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:15.486114 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-87d1ad10-1c5d-4aaa-8184-5ee5c4fec9fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:15.486912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-87d1ad10-1c5d-4aaa-8184-5ee5c4fec9fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:15.491541 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-87d1ad10-1c5d-4aaa-8184-5ee5c4fec9fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:15.491541 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-87d1ad10-1c5d-4aaa-8184-5ee5c4fec9fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:15.491541 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-87d1ad10-1c5d-4aaa-8184-5ee5c4fec9fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:15.642005 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-87d1ad10-1c5d-4aaa-8184-5ee5c4fec9fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:15.650654 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-87d1ad10-1c5d-4aaa-8184-5ee5c4fec9fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.192023 Aug 18 12:21:15.651449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 57/118] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:15 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:16.115686 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-dcc845b9-68bb-4308-91e9-9b4440602db4 req-0f31ed5a-0f4c-44be-ab1b-cb2ee8e867e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4aedfb-2e3b-400c-9c97-9a0939976eb2", "name": "network-vif-plugged", "status": "completed", "tag": "cd3bd10f-38d4-4066-b60f-99ec50c216c4"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:16.127080 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-dcc845b9-68bb-4308-91e9-9b4440602db4 req-0f31ed5a-0f4c-44be-ab1b-cb2ee8e867e9 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:16.127607 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-dcc845b9-68bb-4308-91e9-9b4440602db4 req-0f31ed5a-0f4c-44be-ab1b-cb2ee8e867e9 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:16.128032 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-dcc845b9-68bb-4308-91e9-9b4440602db4 req-0f31ed5a-0f4c-44be-ab1b-cb2ee8e867e9 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:16.139115 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-dcc845b9-68bb-4308-91e9-9b4440602db4 req-0f31ed5a-0f4c-44be-ab1b-cb2ee8e867e9 service nova] Creating event network-vif-plugged:cd3bd10f-38d4-4066-b60f-99ec50c216c4 for instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 on hv-cinder-83602 Aug 18 12:21:16.146205 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-dcc845b9-68bb-4308-91e9-9b4440602db4 req-0f31ed5a-0f4c-44be-ab1b-cb2ee8e867e9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035542 Aug 18 12:21:16.148682 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 62/119] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:21:16.244873 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d8198c71-739e-44c9-8893-ab3751713dfc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:16.245397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d8198c71-739e-44c9-8893-ab3751713dfc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:16.257451 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d8198c71-739e-44c9-8893-ab3751713dfc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:16.257968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d8198c71-739e-44c9-8893-ab3751713dfc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:16.258403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d8198c71-739e-44c9-8893-ab3751713dfc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:16.259103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d8198c71-739e-44c9-8893-ab3751713dfc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:16.259734 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d8198c71-739e-44c9-8893-ab3751713dfc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:16.260515 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d8198c71-739e-44c9-8893-ab3751713dfc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:16.498983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-fcda5ad1-6208-44bf-9f42-7571ab98156a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:16.500462 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-fcda5ad1-6208-44bf-9f42-7571ab98156a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:16.507258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcda5ad1-6208-44bf-9f42-7571ab98156a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:16.508301 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcda5ad1-6208-44bf-9f42-7571ab98156a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:16.508950 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcda5ad1-6208-44bf-9f42-7571ab98156a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:16.509889 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcda5ad1-6208-44bf-9f42-7571ab98156a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:16.510569 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcda5ad1-6208-44bf-9f42-7571ab98156a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:16.511264 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fcda5ad1-6208-44bf-9f42-7571ab98156a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:16.699131 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-fcda5ad1-6208-44bf-9f42-7571ab98156a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:16.711843 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d8198c71-739e-44c9-8893-ab3751713dfc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:16.724378 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-fcda5ad1-6208-44bf-9f42-7571ab98156a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.231170 Aug 18 12:21:16.724979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 63/120] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:16 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:16.725686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d8198c71-739e-44c9-8893-ab3751713dfc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1517 microversion: 2.1 time: 0.485012 Aug 18 12:21:16.736984 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d8664090-50e9-4ddd-986b-967578f15e58 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:16.737598 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d8664090-50e9-4ddd-986b-967578f15e58 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:16.746878 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 58/121] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:16 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1517 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:16.771166 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8664090-50e9-4ddd-986b-967578f15e58 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:16.771509 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d600bc1d-e45a-43d9-92dc-2421288db2d5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:16.774117 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d600bc1d-e45a-43d9-92dc-2421288db2d5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:16.774879 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8664090-50e9-4ddd-986b-967578f15e58 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:16.775344 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8664090-50e9-4ddd-986b-967578f15e58 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:16.776090 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8664090-50e9-4ddd-986b-967578f15e58 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:16.776548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8664090-50e9-4ddd-986b-967578f15e58 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:16.783720 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d8664090-50e9-4ddd-986b-967578f15e58 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:16.790178 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d600bc1d-e45a-43d9-92dc-2421288db2d5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:16.790668 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d600bc1d-e45a-43d9-92dc-2421288db2d5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:16.791105 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d600bc1d-e45a-43d9-92dc-2421288db2d5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:16.791842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d600bc1d-e45a-43d9-92dc-2421288db2d5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:16.792295 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d600bc1d-e45a-43d9-92dc-2421288db2d5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:16.792716 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d600bc1d-e45a-43d9-92dc-2421288db2d5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:16.904194 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-d600bc1d-e45a-43d9-92dc-2421288db2d5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lazy-loading 'flavor' on Instance uuid d584dbe7-cf44-4182-8ee3-3a240b0a8f37 {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:21:17.037237 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d8664090-50e9-4ddd-986b-967578f15e58 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:17.045783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d8664090-50e9-4ddd-986b-967578f15e58 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.317577 Aug 18 12:21:17.047162 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 64/122] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:16 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:17.294777 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d600bc1d-e45a-43d9-92dc-2421288db2d5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "POST /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37/action" status: 200 len: 32 microversion: 2.1 time: 0.546290 Aug 18 12:21:17.296088 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 59/123] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:21:16 2022] POST /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37/action => generated 32 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 12:21:17.306030 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c0d16a58-506b-4aec-8411-8423854e92a4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:17.306634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c0d16a58-506b-4aec-8411-8423854e92a4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:17.313136 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0d16a58-506b-4aec-8411-8423854e92a4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:17.313738 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0d16a58-506b-4aec-8411-8423854e92a4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:17.314162 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0d16a58-506b-4aec-8411-8423854e92a4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:17.314856 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0d16a58-506b-4aec-8411-8423854e92a4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:17.315298 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0d16a58-506b-4aec-8411-8423854e92a4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:17.316245 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0d16a58-506b-4aec-8411-8423854e92a4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:17.473025 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c0d16a58-506b-4aec-8411-8423854e92a4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:17.482332 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c0d16a58-506b-4aec-8411-8423854e92a4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.179960 Aug 18 12:21:17.496990 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 65/124] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:17 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:17.746893 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6606481e-14f0-4777-9d84-4764eaa464a8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:17.747620 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-6606481e-14f0-4777-9d84-4764eaa464a8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:17.754832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6606481e-14f0-4777-9d84-4764eaa464a8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:17.755305 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6606481e-14f0-4777-9d84-4764eaa464a8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:17.755762 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6606481e-14f0-4777-9d84-4764eaa464a8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:17.756468 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6606481e-14f0-4777-9d84-4764eaa464a8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:17.756910 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6606481e-14f0-4777-9d84-4764eaa464a8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:17.757328 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6606481e-14f0-4777-9d84-4764eaa464a8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:17.963250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-6606481e-14f0-4777-9d84-4764eaa464a8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:17.972098 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-6606481e-14f0-4777-9d84-4764eaa464a8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.229936 Aug 18 12:21:17.987155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 60/125] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:17 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:18.067830 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-077e1e4f-603f-479f-8b57-5db2b03033a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:18.069192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-077e1e4f-603f-479f-8b57-5db2b03033a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:18.077637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-077e1e4f-603f-479f-8b57-5db2b03033a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:18.078586 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-077e1e4f-603f-479f-8b57-5db2b03033a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:18.079459 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-077e1e4f-603f-479f-8b57-5db2b03033a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:18.085483 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-077e1e4f-603f-479f-8b57-5db2b03033a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:18.085483 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-077e1e4f-603f-479f-8b57-5db2b03033a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:18.085483 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-077e1e4f-603f-479f-8b57-5db2b03033a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:18.164293 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-426f8bf8-4079-497e-96c2-62532e45ac19 req-62023114-b053-4c48-ac7f-86a7f74dd637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c885cd6b-b031-4755-bfc7-f597267136dd", "name": "network-vif-plugged", "status": "completed", "tag": "0352601f-0b74-4242-ba88-196fa16f9887"}, {"server_uuid": "316b26d0-6178-4b02-8207-e910af024af2", "name": "network-vif-plugged", "status": "completed", "tag": "b8ccdcb7-b2f1-4bf6-ad93-0a6747cda292"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:18.186119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-426f8bf8-4079-497e-96c2-62532e45ac19 req-62023114-b053-4c48-ac7f-86a7f74dd637 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:18.186588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-426f8bf8-4079-497e-96c2-62532e45ac19 req-62023114-b053-4c48-ac7f-86a7f74dd637 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:18.187012 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-426f8bf8-4079-497e-96c2-62532e45ac19 req-62023114-b053-4c48-ac7f-86a7f74dd637 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:18.200392 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-426f8bf8-4079-497e-96c2-62532e45ac19 req-62023114-b053-4c48-ac7f-86a7f74dd637 service nova] Creating event network-vif-plugged:0352601f-0b74-4242-ba88-196fa16f9887 for instance c885cd6b-b031-4755-bfc7-f597267136dd on hv-cinder-83602 Aug 18 12:21:18.201111 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-426f8bf8-4079-497e-96c2-62532e45ac19 req-62023114-b053-4c48-ac7f-86a7f74dd637 service nova] Creating event network-vif-plugged:b8ccdcb7-b2f1-4bf6-ad93-0a6747cda292 for instance 316b26d0-6178-4b02-8207-e910af024af2 on hv-cinder-83602 Aug 18 12:21:18.208462 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-426f8bf8-4079-497e-96c2-62532e45ac19 req-62023114-b053-4c48-ac7f-86a7f74dd637 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049711 Aug 18 12:21:18.209066 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 61/126] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:21:18.359651 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-077e1e4f-603f-479f-8b57-5db2b03033a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:18.367736 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-077e1e4f-603f-479f-8b57-5db2b03033a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.304344 Aug 18 12:21:18.368312 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 66/127] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:18 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:18.517539 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-72f60822-b7e8-4f2d-bfea-e2b574acc288 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:18.518255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-72f60822-b7e8-4f2d-bfea-e2b574acc288 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:18.524837 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72f60822-b7e8-4f2d-bfea-e2b574acc288 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:18.525314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72f60822-b7e8-4f2d-bfea-e2b574acc288 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:18.530850 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72f60822-b7e8-4f2d-bfea-e2b574acc288 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:18.530850 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72f60822-b7e8-4f2d-bfea-e2b574acc288 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:18.530850 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72f60822-b7e8-4f2d-bfea-e2b574acc288 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:18.530850 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-72f60822-b7e8-4f2d-bfea-e2b574acc288 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:18.837472 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-72f60822-b7e8-4f2d-bfea-e2b574acc288 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:18.844647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-72f60822-b7e8-4f2d-bfea-e2b574acc288 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.333215 Aug 18 12:21:18.849625 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 62/128] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:18 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:18.993426 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f45fe55a-a924-4a2b-ba72-d55edbd30311 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:18.994026 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f45fe55a-a924-4a2b-ba72-d55edbd30311 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:19.001186 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f45fe55a-a924-4a2b-ba72-d55edbd30311 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:19.001360 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f45fe55a-a924-4a2b-ba72-d55edbd30311 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:19.001844 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f45fe55a-a924-4a2b-ba72-d55edbd30311 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:19.003221 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f45fe55a-a924-4a2b-ba72-d55edbd30311 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:19.003221 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f45fe55a-a924-4a2b-ba72-d55edbd30311 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:19.003429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f45fe55a-a924-4a2b-ba72-d55edbd30311 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:19.156769 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f45fe55a-a924-4a2b-ba72-d55edbd30311 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:19.164389 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f45fe55a-a924-4a2b-ba72-d55edbd30311 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.174774 Aug 18 12:21:19.164932 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 67/129] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:18 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:19.393554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6513536e-e566-402e-9d57-80506e20d294 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:19.394517 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-6513536e-e566-402e-9d57-80506e20d294 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:19.403921 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6513536e-e566-402e-9d57-80506e20d294 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:19.404492 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6513536e-e566-402e-9d57-80506e20d294 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:19.405554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6513536e-e566-402e-9d57-80506e20d294 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:19.406323 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6513536e-e566-402e-9d57-80506e20d294 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:19.406838 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6513536e-e566-402e-9d57-80506e20d294 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:19.407360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6513536e-e566-402e-9d57-80506e20d294 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:19.411860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:19.555668 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-6513536e-e566-402e-9d57-80506e20d294 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:19.563296 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-6513536e-e566-402e-9d57-80506e20d294 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.173612 Aug 18 12:21:19.563898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 63/130] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:19 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:19.872453 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-db2b69b2-ed25-4464-b0b7-00fbb9671997 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:19.882236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-db2b69b2-ed25-4464-b0b7-00fbb9671997 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:19.882236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db2b69b2-ed25-4464-b0b7-00fbb9671997 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:19.882236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db2b69b2-ed25-4464-b0b7-00fbb9671997 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:19.882236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db2b69b2-ed25-4464-b0b7-00fbb9671997 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:19.882815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db2b69b2-ed25-4464-b0b7-00fbb9671997 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:19.882815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db2b69b2-ed25-4464-b0b7-00fbb9671997 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:19.882815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db2b69b2-ed25-4464-b0b7-00fbb9671997 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:20.025373 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-db2b69b2-ed25-4464-b0b7-00fbb9671997 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:20.034860 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-db2b69b2-ed25-4464-b0b7-00fbb9671997 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.166386 Aug 18 12:21:20.035777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 68/131] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:19 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:20.185209 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d375e4e8-a14e-4da6-81b0-df43a6d99597 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:20.186679 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d375e4e8-a14e-4da6-81b0-df43a6d99597 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:20.194126 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d375e4e8-a14e-4da6-81b0-df43a6d99597 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:20.194566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d375e4e8-a14e-4da6-81b0-df43a6d99597 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:20.195222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d375e4e8-a14e-4da6-81b0-df43a6d99597 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:20.196033 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d375e4e8-a14e-4da6-81b0-df43a6d99597 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:20.196486 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d375e4e8-a14e-4da6-81b0-df43a6d99597 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:20.197070 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d375e4e8-a14e-4da6-81b0-df43a6d99597 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:20.362990 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d375e4e8-a14e-4da6-81b0-df43a6d99597 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:20.371381 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d375e4e8-a14e-4da6-81b0-df43a6d99597 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1361 microversion: 2.1 time: 0.189970 Aug 18 12:21:20.372311 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 64/132] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:20 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:20.585518 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-1202574d-5842-4d98-aaa1-48fec64fa7b6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:20.586257 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-1202574d-5842-4d98-aaa1-48fec64fa7b6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:20.595396 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1202574d-5842-4d98-aaa1-48fec64fa7b6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:20.596438 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1202574d-5842-4d98-aaa1-48fec64fa7b6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:20.596438 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1202574d-5842-4d98-aaa1-48fec64fa7b6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:20.599473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1202574d-5842-4d98-aaa1-48fec64fa7b6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:20.600054 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1202574d-5842-4d98-aaa1-48fec64fa7b6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:20.600625 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1202574d-5842-4d98-aaa1-48fec64fa7b6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:20.959772 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-1202574d-5842-4d98-aaa1-48fec64fa7b6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:20.967744 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-1202574d-5842-4d98-aaa1-48fec64fa7b6 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1315 microversion: 2.1 time: 0.386541 Aug 18 12:21:20.968531 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 69/133] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:20 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:21.056204 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e45e8dfa-5bea-4b70-a6eb-3e787585593b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:21.056811 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e45e8dfa-5bea-4b70-a6eb-3e787585593b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:21.064339 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45e8dfa-5bea-4b70-a6eb-3e787585593b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:21.064819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45e8dfa-5bea-4b70-a6eb-3e787585593b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:21.065252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45e8dfa-5bea-4b70-a6eb-3e787585593b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:21.069551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45e8dfa-5bea-4b70-a6eb-3e787585593b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:21.069551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45e8dfa-5bea-4b70-a6eb-3e787585593b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:21.069551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45e8dfa-5bea-4b70-a6eb-3e787585593b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:21.235674 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e45e8dfa-5bea-4b70-a6eb-3e787585593b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:21.243172 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e45e8dfa-5bea-4b70-a6eb-3e787585593b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.190858 Aug 18 12:21:21.243770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 65/134] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:21 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:21.392381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-834862bd-c48b-4e32-9812-ccdd83b9a125 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:21.393086 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-834862bd-c48b-4e32-9812-ccdd83b9a125 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:21.400481 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-834862bd-c48b-4e32-9812-ccdd83b9a125 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:21.402592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-834862bd-c48b-4e32-9812-ccdd83b9a125 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:21.402592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-834862bd-c48b-4e32-9812-ccdd83b9a125 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:21.402592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-834862bd-c48b-4e32-9812-ccdd83b9a125 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:21.402809 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-834862bd-c48b-4e32-9812-ccdd83b9a125 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:21.403448 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-834862bd-c48b-4e32-9812-ccdd83b9a125 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:21.408575 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=100 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:21.530917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-834862bd-c48b-4e32-9812-ccdd83b9a125 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:21.538347 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-834862bd-c48b-4e32-9812-ccdd83b9a125 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1547 microversion: 2.1 time: 0.149926 Aug 18 12:21:21.540332 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 70/135] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:21 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:21.564002 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3a7c16f4-f7a8-4e29-ba28-d39c4a1d08d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:21.564497 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3a7c16f4-f7a8-4e29-ba28-d39c4a1d08d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:21.570653 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a7c16f4-f7a8-4e29-ba28-d39c4a1d08d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:21.576671 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a7c16f4-f7a8-4e29-ba28-d39c4a1d08d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:21.576671 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a7c16f4-f7a8-4e29-ba28-d39c4a1d08d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:21.576671 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a7c16f4-f7a8-4e29-ba28-d39c4a1d08d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:21.576671 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a7c16f4-f7a8-4e29-ba28-d39c4a1d08d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:21.577025 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a7c16f4-f7a8-4e29-ba28-d39c4a1d08d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:21.653301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3a7c16f4-f7a8-4e29-ba28-d39c4a1d08d9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093569 Aug 18 12:21:21.654138 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 66/136] 10.222.0.98 () {58 vars in 1275 bytes} [Thu Aug 18 12:21:21 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:21:21.988754 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-cd8ddb06-1e0e-4442-8061-1289e5caddc1 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:21.989362 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-cd8ddb06-1e0e-4442-8061-1289e5caddc1 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:21.995951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cd8ddb06-1e0e-4442-8061-1289e5caddc1 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:21.996519 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cd8ddb06-1e0e-4442-8061-1289e5caddc1 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:21.996956 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cd8ddb06-1e0e-4442-8061-1289e5caddc1 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:21.997651 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cd8ddb06-1e0e-4442-8061-1289e5caddc1 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:21.998094 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cd8ddb06-1e0e-4442-8061-1289e5caddc1 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:21.998541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cd8ddb06-1e0e-4442-8061-1289e5caddc1 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:22.265201 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-79295f18-169d-4ccc-94ae-3fa1dfae6aef tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:22.265958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-79295f18-169d-4ccc-94ae-3fa1dfae6aef tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:22.272436 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79295f18-169d-4ccc-94ae-3fa1dfae6aef tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:22.273015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79295f18-169d-4ccc-94ae-3fa1dfae6aef tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:22.273519 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79295f18-169d-4ccc-94ae-3fa1dfae6aef tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:22.274302 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79295f18-169d-4ccc-94ae-3fa1dfae6aef tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:22.274826 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79295f18-169d-4ccc-94ae-3fa1dfae6aef tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:22.275499 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79295f18-169d-4ccc-94ae-3fa1dfae6aef tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:22.322346 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-cd8ddb06-1e0e-4442-8061-1289e5caddc1 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:22.333734 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-cd8ddb06-1e0e-4442-8061-1289e5caddc1 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1501 microversion: 2.1 time: 0.349234 Aug 18 12:21:22.354438 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 71/137] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:21 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1501 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:22.451504 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-79295f18-169d-4ccc-94ae-3fa1dfae6aef tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:22.462003 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-79295f18-169d-4ccc-94ae-3fa1dfae6aef tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.201103 Aug 18 12:21:22.463246 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 67/138] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:22 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:23.268767 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-41604caa-2684-495a-8926-488446a10078 req-6f2cc8a3-7b36-4490-9225-63cefeb53396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316b26d0-6178-4b02-8207-e910af024af2", "tag": "b8ccdcb7-b2f1-4bf6-ad93-0a6747cda292"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:23.308691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-41604caa-2684-495a-8926-488446a10078 req-6f2cc8a3-7b36-4490-9225-63cefeb53396 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:23.308691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-41604caa-2684-495a-8926-488446a10078 req-6f2cc8a3-7b36-4490-9225-63cefeb53396 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:23.308691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-41604caa-2684-495a-8926-488446a10078 req-6f2cc8a3-7b36-4490-9225-63cefeb53396 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:23.311486 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-41604caa-2684-495a-8926-488446a10078 req-6f2cc8a3-7b36-4490-9225-63cefeb53396 service nova] Creating event network-changed:b8ccdcb7-b2f1-4bf6-ad93-0a6747cda292 for instance 316b26d0-6178-4b02-8207-e910af024af2 on hv-cinder-83602 Aug 18 12:21:23.316558 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-41604caa-2684-495a-8926-488446a10078 req-6f2cc8a3-7b36-4490-9225-63cefeb53396 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052337 Aug 18 12:21:23.317652 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 72/139] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:21:23.486260 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ae7b834e-f03a-476f-928d-16d513eda59f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:23.488212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ae7b834e-f03a-476f-928d-16d513eda59f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:23.497385 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae7b834e-f03a-476f-928d-16d513eda59f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:23.498202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae7b834e-f03a-476f-928d-16d513eda59f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:23.500098 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae7b834e-f03a-476f-928d-16d513eda59f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:23.501703 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae7b834e-f03a-476f-928d-16d513eda59f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:23.502520 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae7b834e-f03a-476f-928d-16d513eda59f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:23.503246 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae7b834e-f03a-476f-928d-16d513eda59f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:23.740756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ae7b834e-f03a-476f-928d-16d513eda59f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:23.751941 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ae7b834e-f03a-476f-928d-16d513eda59f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.271670 Aug 18 12:21:23.752685 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 68/140] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:23 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:24.632785 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-be0d2d47-d14d-48dc-88a4-c568fddfe278 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "accfc5d2-6a89-45d8-b77c-f39de51e8cc2"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:24.635346 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-be0d2d47-d14d-48dc-88a4-c568fddfe278 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:24.641512 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0d2d47-d14d-48dc-88a4-c568fddfe278 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:24.641982 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0d2d47-d14d-48dc-88a4-c568fddfe278 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:24.655126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0d2d47-d14d-48dc-88a4-c568fddfe278 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:24.655126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0d2d47-d14d-48dc-88a4-c568fddfe278 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:24.655126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0d2d47-d14d-48dc-88a4-c568fddfe278 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:24.655126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0d2d47-d14d-48dc-88a4-c568fddfe278 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:24.772609 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-be617f11-8d82-4d31-9acd-b6e9629199de tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:24.774052 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-be617f11-8d82-4d31-9acd-b6e9629199de tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:24.781426 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be617f11-8d82-4d31-9acd-b6e9629199de tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:24.782220 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be617f11-8d82-4d31-9acd-b6e9629199de tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:24.782653 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be617f11-8d82-4d31-9acd-b6e9629199de tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:24.783370 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be617f11-8d82-4d31-9acd-b6e9629199de tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:24.783946 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be617f11-8d82-4d31-9acd-b6e9629199de tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:24.784250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be617f11-8d82-4d31-9acd-b6e9629199de tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:24.928136 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-be617f11-8d82-4d31-9acd-b6e9629199de tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:24.936916 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-be617f11-8d82-4d31-9acd-b6e9629199de tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.168297 Aug 18 12:21:24.937492 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 69/141] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:24 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:25.602052 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-be0d2d47-d14d-48dc-88a4-c568fddfe278 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "POST /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.973345 Aug 18 12:21:25.602724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 73/142] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:21:24 2022] POST /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd/os-volume_attachments => generated 194 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:21:25.957445 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7d3d05d1-3936-4102-acbd-3b0052d87ce2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:25.958057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7d3d05d1-3936-4102-acbd-3b0052d87ce2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:25.964237 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7d3d05d1-3936-4102-acbd-3b0052d87ce2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:25.964792 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7d3d05d1-3936-4102-acbd-3b0052d87ce2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:25.965233 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7d3d05d1-3936-4102-acbd-3b0052d87ce2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:25.965922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7d3d05d1-3936-4102-acbd-3b0052d87ce2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:25.966375 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7d3d05d1-3936-4102-acbd-3b0052d87ce2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:25.966799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7d3d05d1-3936-4102-acbd-3b0052d87ce2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:26.119973 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7d3d05d1-3936-4102-acbd-3b0052d87ce2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:26.128318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7d3d05d1-3936-4102-acbd-3b0052d87ce2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.174768 Aug 18 12:21:26.128887 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 70/143] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:25 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:27.151429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8fa4912d-404b-487d-ab01-22ff9a21f011 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:27.152122 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8fa4912d-404b-487d-ab01-22ff9a21f011 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:27.159367 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fa4912d-404b-487d-ab01-22ff9a21f011 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:27.159878 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fa4912d-404b-487d-ab01-22ff9a21f011 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:27.160305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fa4912d-404b-487d-ab01-22ff9a21f011 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:27.161120 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fa4912d-404b-487d-ab01-22ff9a21f011 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:27.161572 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fa4912d-404b-487d-ab01-22ff9a21f011 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:27.161991 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fa4912d-404b-487d-ab01-22ff9a21f011 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:27.295328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8fa4912d-404b-487d-ab01-22ff9a21f011 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:27.302931 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8fa4912d-404b-487d-ab01-22ff9a21f011 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.156421 Aug 18 12:21:27.303517 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 74/144] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:27 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:28.324833 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-aa8bb4b9-3fa4-4a2a-9336-8d3c9240396d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:28.326041 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-aa8bb4b9-3fa4-4a2a-9336-8d3c9240396d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:28.334142 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aa8bb4b9-3fa4-4a2a-9336-8d3c9240396d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:28.334634 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aa8bb4b9-3fa4-4a2a-9336-8d3c9240396d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:28.335071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aa8bb4b9-3fa4-4a2a-9336-8d3c9240396d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:28.335805 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aa8bb4b9-3fa4-4a2a-9336-8d3c9240396d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:28.337561 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aa8bb4b9-3fa4-4a2a-9336-8d3c9240396d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:28.338008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aa8bb4b9-3fa4-4a2a-9336-8d3c9240396d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:28.575488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-aa8bb4b9-3fa4-4a2a-9336-8d3c9240396d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:28.583206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-aa8bb4b9-3fa4-4a2a-9336-8d3c9240396d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.263371 Aug 18 12:21:28.583824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 71/145] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:28 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:29.605800 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-43f4d882-42e2-4c66-acaa-5df47b954ce1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:29.607591 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-43f4d882-42e2-4c66-acaa-5df47b954ce1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:29.615710 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43f4d882-42e2-4c66-acaa-5df47b954ce1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:29.618529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43f4d882-42e2-4c66-acaa-5df47b954ce1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:29.618529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43f4d882-42e2-4c66-acaa-5df47b954ce1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:29.618529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43f4d882-42e2-4c66-acaa-5df47b954ce1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:29.618529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43f4d882-42e2-4c66-acaa-5df47b954ce1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:29.618887 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43f4d882-42e2-4c66-acaa-5df47b954ce1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:29.758246 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-43f4d882-42e2-4c66-acaa-5df47b954ce1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:29.767212 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-43f4d882-42e2-4c66-acaa-5df47b954ce1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.165962 Aug 18 12:21:29.768176 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 75/146] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:29 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:30.789650 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1e3e21c0-7070-41f7-b7cc-17296011378d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:30.790266 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1e3e21c0-7070-41f7-b7cc-17296011378d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:30.793756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=73 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:30.802640 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e3e21c0-7070-41f7-b7cc-17296011378d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:30.803298 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e3e21c0-7070-41f7-b7cc-17296011378d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:30.803908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e3e21c0-7070-41f7-b7cc-17296011378d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:30.804783 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e3e21c0-7070-41f7-b7cc-17296011378d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:30.805384 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e3e21c0-7070-41f7-b7cc-17296011378d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:30.805955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e3e21c0-7070-41f7-b7cc-17296011378d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:30.943272 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1e3e21c0-7070-41f7-b7cc-17296011378d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:30.951077 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1e3e21c0-7070-41f7-b7cc-17296011378d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.165367 Aug 18 12:21:30.951679 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 72/147] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:30 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:31.973062 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f4c6f25b-0811-480d-abf0-311ff944ccd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:31.974073 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f4c6f25b-0811-480d-abf0-311ff944ccd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:31.976602 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=72 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:31.981359 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f4c6f25b-0811-480d-abf0-311ff944ccd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:31.981835 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f4c6f25b-0811-480d-abf0-311ff944ccd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:31.982270 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f4c6f25b-0811-480d-abf0-311ff944ccd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:31.982958 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f4c6f25b-0811-480d-abf0-311ff944ccd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:31.983406 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f4c6f25b-0811-480d-abf0-311ff944ccd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:31.983849 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f4c6f25b-0811-480d-abf0-311ff944ccd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:32.127060 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f4c6f25b-0811-480d-abf0-311ff944ccd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:32.140265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f4c6f25b-0811-480d-abf0-311ff944ccd1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.170313 Aug 18 12:21:32.141072 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 76/148] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:31 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:33.161982 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-dc86a130-806c-4a76-a267-acd2c200296a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:33.162574 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-dc86a130-806c-4a76-a267-acd2c200296a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:33.168542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc86a130-806c-4a76-a267-acd2c200296a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:33.169014 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc86a130-806c-4a76-a267-acd2c200296a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:33.169462 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc86a130-806c-4a76-a267-acd2c200296a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:33.170138 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc86a130-806c-4a76-a267-acd2c200296a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:33.170579 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc86a130-806c-4a76-a267-acd2c200296a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:33.170994 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc86a130-806c-4a76-a267-acd2c200296a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:33.297263 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-dc86a130-806c-4a76-a267-acd2c200296a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:33.304613 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-dc86a130-806c-4a76-a267-acd2c200296a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.146800 Aug 18 12:21:33.305173 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 73/149] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:33 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:34.327797 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-32be43ee-ad23-4835-a2ea-7673ef8d35bc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:34.338230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-32be43ee-ad23-4835-a2ea-7673ef8d35bc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:34.338230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32be43ee-ad23-4835-a2ea-7673ef8d35bc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:34.338230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32be43ee-ad23-4835-a2ea-7673ef8d35bc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:34.338230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32be43ee-ad23-4835-a2ea-7673ef8d35bc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:34.338736 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32be43ee-ad23-4835-a2ea-7673ef8d35bc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:34.338736 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32be43ee-ad23-4835-a2ea-7673ef8d35bc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:34.338736 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32be43ee-ad23-4835-a2ea-7673ef8d35bc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:34.502521 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-32be43ee-ad23-4835-a2ea-7673ef8d35bc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:34.510698 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-32be43ee-ad23-4835-a2ea-7673ef8d35bc tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.187908 Aug 18 12:21:34.511196 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 77/150] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:34 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:35.531711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-37668ff6-26db-4616-9f6b-3e55a28007e1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:35.532303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-37668ff6-26db-4616-9f6b-3e55a28007e1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:35.538408 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37668ff6-26db-4616-9f6b-3e55a28007e1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:35.538891 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37668ff6-26db-4616-9f6b-3e55a28007e1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:35.539326 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37668ff6-26db-4616-9f6b-3e55a28007e1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:35.540045 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37668ff6-26db-4616-9f6b-3e55a28007e1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:35.540490 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37668ff6-26db-4616-9f6b-3e55a28007e1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:35.540913 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37668ff6-26db-4616-9f6b-3e55a28007e1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:35.680892 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-37668ff6-26db-4616-9f6b-3e55a28007e1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:35.686596 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-37668ff6-26db-4616-9f6b-3e55a28007e1 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.158908 Aug 18 12:21:35.687166 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 74/151] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:35 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:36.708462 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f71b93f9-9948-4f2c-9be6-c2af962ff05b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:36.709214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f71b93f9-9948-4f2c-9be6-c2af962ff05b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:36.715776 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f71b93f9-9948-4f2c-9be6-c2af962ff05b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:36.716362 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f71b93f9-9948-4f2c-9be6-c2af962ff05b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:36.716864 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f71b93f9-9948-4f2c-9be6-c2af962ff05b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:36.718328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f71b93f9-9948-4f2c-9be6-c2af962ff05b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:36.718850 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f71b93f9-9948-4f2c-9be6-c2af962ff05b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:36.719345 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f71b93f9-9948-4f2c-9be6-c2af962ff05b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:36.854433 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f71b93f9-9948-4f2c-9be6-c2af962ff05b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:36.863315 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f71b93f9-9948-4f2c-9be6-c2af962ff05b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.159052 Aug 18 12:21:36.864207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 78/152] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:36 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:37.890487 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-58ae0768-066c-46d6-8532-546872d8d3a0 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:37.890487 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-58ae0768-066c-46d6-8532-546872d8d3a0 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:37.896427 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-58ae0768-066c-46d6-8532-546872d8d3a0 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:37.897529 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-58ae0768-066c-46d6-8532-546872d8d3a0 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:37.898498 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-58ae0768-066c-46d6-8532-546872d8d3a0 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:37.899384 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-58ae0768-066c-46d6-8532-546872d8d3a0 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:37.900050 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-58ae0768-066c-46d6-8532-546872d8d3a0 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:37.900714 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-58ae0768-066c-46d6-8532-546872d8d3a0 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:38.128454 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-58ae0768-066c-46d6-8532-546872d8d3a0 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:38.136510 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-58ae0768-066c-46d6-8532-546872d8d3a0 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.253801 Aug 18 12:21:38.137155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 75/153] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:37 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:38.819622 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-94d4e44d-b0c0-4118-a61b-c12dd49ef9a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:38.820155 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-94d4e44d-b0c0-4118-a61b-c12dd49ef9a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:38.827693 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-94d4e44d-b0c0-4118-a61b-c12dd49ef9a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:38.828808 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-94d4e44d-b0c0-4118-a61b-c12dd49ef9a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:38.829284 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-94d4e44d-b0c0-4118-a61b-c12dd49ef9a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:38.830106 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-94d4e44d-b0c0-4118-a61b-c12dd49ef9a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:38.830638 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-94d4e44d-b0c0-4118-a61b-c12dd49ef9a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:38.830963 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-94d4e44d-b0c0-4118-a61b-c12dd49ef9a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:38.864977 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-94d4e44d-b0c0-4118-a61b-c12dd49ef9a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Going to try to terminate instance {{(pid=121244) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:21:39.157710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-32e637eb-c35d-47df-9776-8735e1df2eff tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:39.158315 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-32e637eb-c35d-47df-9776-8735e1df2eff tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:39.164554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-32e637eb-c35d-47df-9776-8735e1df2eff tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:39.165033 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-32e637eb-c35d-47df-9776-8735e1df2eff tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:39.165464 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-32e637eb-c35d-47df-9776-8735e1df2eff tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:39.166146 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-32e637eb-c35d-47df-9776-8735e1df2eff tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:39.166605 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-32e637eb-c35d-47df-9776-8735e1df2eff tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:39.167016 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-32e637eb-c35d-47df-9776-8735e1df2eff tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:39.220808 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-94d4e44d-b0c0-4118-a61b-c12dd49ef9a9 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 204 len: 0 microversion: 2.1 time: 0.401883 Aug 18 12:21:39.221686 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 79/154] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:21:38 2022] DELETE /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:21:39.230175 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-48ab0b03-5e06-4b68-8635-ae2cef464b33 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:39.231306 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-48ab0b03-5e06-4b68-8635-ae2cef464b33 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:39.240263 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-48ab0b03-5e06-4b68-8635-ae2cef464b33 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:39.241062 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-48ab0b03-5e06-4b68-8635-ae2cef464b33 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:39.241569 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-48ab0b03-5e06-4b68-8635-ae2cef464b33 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:39.242335 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-48ab0b03-5e06-4b68-8635-ae2cef464b33 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:39.242854 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-48ab0b03-5e06-4b68-8635-ae2cef464b33 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:39.243355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-48ab0b03-5e06-4b68-8635-ae2cef464b33 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:39.351830 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-32e637eb-c35d-47df-9776-8735e1df2eff tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:39.358542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-32e637eb-c35d-47df-9776-8735e1df2eff tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.205219 Aug 18 12:21:39.359122 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 76/155] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:39 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:39.401828 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-48ab0b03-5e06-4b68-8635-ae2cef464b33 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:39.410842 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-48ab0b03-5e06-4b68-8635-ae2cef464b33 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1553 microversion: 2.1 time: 0.184868 Aug 18 12:21:39.411432 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 80/156] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:39 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:40.383842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-76f119b3-f6b3-4f66-97e8-6fa7dd059abb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:40.384783 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-76f119b3-f6b3-4f66-97e8-6fa7dd059abb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:40.393106 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-76f119b3-f6b3-4f66-97e8-6fa7dd059abb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:40.395991 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-76f119b3-f6b3-4f66-97e8-6fa7dd059abb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:40.395991 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-76f119b3-f6b3-4f66-97e8-6fa7dd059abb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:40.395991 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-76f119b3-f6b3-4f66-97e8-6fa7dd059abb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:40.395991 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-76f119b3-f6b3-4f66-97e8-6fa7dd059abb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:40.397252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-76f119b3-f6b3-4f66-97e8-6fa7dd059abb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:40.431099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-56b4da13-afdc-4e3c-a4d0-676c97c5692c tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:40.432434 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-56b4da13-afdc-4e3c-a4d0-676c97c5692c tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:40.442335 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-56b4da13-afdc-4e3c-a4d0-676c97c5692c tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:40.443615 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-56b4da13-afdc-4e3c-a4d0-676c97c5692c tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:40.444058 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-56b4da13-afdc-4e3c-a4d0-676c97c5692c tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:40.444767 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-56b4da13-afdc-4e3c-a4d0-676c97c5692c tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:40.445223 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-56b4da13-afdc-4e3c-a4d0-676c97c5692c tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:40.445676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-56b4da13-afdc-4e3c-a4d0-676c97c5692c tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:40.606850 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-56b4da13-afdc-4e3c-a4d0-676c97c5692c tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:40.617364 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-56b4da13-afdc-4e3c-a4d0-676c97c5692c tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1553 microversion: 2.1 time: 0.190094 Aug 18 12:21:40.626385 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 81/157] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:40 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:40.626479 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-76f119b3-f6b3-4f66-97e8-6fa7dd059abb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:40.638792 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-76f119b3-f6b3-4f66-97e8-6fa7dd059abb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.262558 Aug 18 12:21:40.639968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 77/158] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:40 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:41.646524 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-43a99ae0-7062-4dbe-a0d7-0f74b031d37a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:41.647805 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-43a99ae0-7062-4dbe-a0d7-0f74b031d37a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:41.654609 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43a99ae0-7062-4dbe-a0d7-0f74b031d37a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:41.655097 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43a99ae0-7062-4dbe-a0d7-0f74b031d37a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:41.655554 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43a99ae0-7062-4dbe-a0d7-0f74b031d37a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:41.656429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43a99ae0-7062-4dbe-a0d7-0f74b031d37a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:41.656888 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43a99ae0-7062-4dbe-a0d7-0f74b031d37a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:41.663991 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f5dd0fc8-8908-4c27-8d4c-6ca70b87c946 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:41.664600 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f5dd0fc8-8908-4c27-8d4c-6ca70b87c946 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:41.668257 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-43a99ae0-7062-4dbe-a0d7-0f74b031d37a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:41.671978 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f5dd0fc8-8908-4c27-8d4c-6ca70b87c946 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:41.672625 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f5dd0fc8-8908-4c27-8d4c-6ca70b87c946 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:41.673980 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f5dd0fc8-8908-4c27-8d4c-6ca70b87c946 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:41.675559 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f5dd0fc8-8908-4c27-8d4c-6ca70b87c946 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:41.676185 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f5dd0fc8-8908-4c27-8d4c-6ca70b87c946 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:41.676927 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f5dd0fc8-8908-4c27-8d4c-6ca70b87c946 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:41.884523 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-43a99ae0-7062-4dbe-a0d7-0f74b031d37a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:41.897023 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-43a99ae0-7062-4dbe-a0d7-0f74b031d37a tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1553 microversion: 2.1 time: 0.255269 Aug 18 12:21:41.898456 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 82/159] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:41 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:41.910857 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1571154639", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:41.973984 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] validate_networks() for None {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:21:42.145302 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f5dd0fc8-8908-4c27-8d4c-6ca70b87c946 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:42.153959 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f5dd0fc8-8908-4c27-8d4c-6ca70b87c946 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.493803 Aug 18 12:21:42.156799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 78/160] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:41 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:42.326369 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:21:42.327503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:21:42.327979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:21:42.328388 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:21:42.328811 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:21:42.339464 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:42.341403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:42.341403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:42.341403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:42.342695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:42.343448 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:42.367972 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Getting quotas for project 9b2edbbd46f54ad29ce12dad1762aaa7. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:21:42.375045 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Getting quotas for user 991cdaf69fd5439c9cad12cc2be49ada and project 9b2edbbd46f54ad29ce12dad1762aaa7. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:21:42.393493 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:21:42.397608 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:21:42.450964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-f47d38eb-1af9-4870-a4e5-a3bccae86b18 req-55688ef9-e33d-410c-9c2f-ba793095845c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c885cd6b-b031-4755-bfc7-f597267136dd", "name": "network-vif-deleted", "tag": "0352601f-0b74-4242-ba88-196fa16f9887"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:42.468554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f47d38eb-1af9-4870-a4e5-a3bccae86b18 req-55688ef9-e33d-410c-9c2f-ba793095845c service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:42.471065 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f47d38eb-1af9-4870-a4e5-a3bccae86b18 req-55688ef9-e33d-410c-9c2f-ba793095845c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:42.472490 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f47d38eb-1af9-4870-a4e5-a3bccae86b18 req-55688ef9-e33d-410c-9c2f-ba793095845c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:42.490984 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-f47d38eb-1af9-4870-a4e5-a3bccae86b18 req-55688ef9-e33d-410c-9c2f-ba793095845c service nova] Creating event network-vif-deleted:0352601f-0b74-4242-ba88-196fa16f9887 for instance c885cd6b-b031-4755-bfc7-f597267136dd on hv-cinder-83602 Aug 18 12:21:42.497645 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-f47d38eb-1af9-4870-a4e5-a3bccae86b18 req-55688ef9-e33d-410c-9c2f-ba793095845c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051382 Aug 18 12:21:42.498813 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 79/161] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:21:42.598732 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8b05d1ca-f2e0-443b-a8b1-3a5002f0ef3d tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699068 Aug 18 12:21:42.599713 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 83/162] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:21:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:21:42.612457 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-62045daa-9352-4e40-a54c-774c1f7a2443 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:42.613273 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-62045daa-9352-4e40-a54c-774c1f7a2443 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:42.671072 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-62045daa-9352-4e40-a54c-774c1f7a2443 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:42.677903 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-62045daa-9352-4e40-a54c-774c1f7a2443 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1215 microversion: 2.1 time: 0.070865 Aug 18 12:21:42.678558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 80/163] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:42 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:42.918786 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-791259b6-d803-47e3-8e05-7a47d31315c8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:42.919681 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-791259b6-d803-47e3-8e05-7a47d31315c8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:42.926193 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-791259b6-d803-47e3-8e05-7a47d31315c8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:42.926676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-791259b6-d803-47e3-8e05-7a47d31315c8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:42.927111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-791259b6-d803-47e3-8e05-7a47d31315c8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:42.927837 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-791259b6-d803-47e3-8e05-7a47d31315c8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:42.928299 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-791259b6-d803-47e3-8e05-7a47d31315c8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:42.928726 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-791259b6-d803-47e3-8e05-7a47d31315c8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:42.992256 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-791259b6-d803-47e3-8e05-7a47d31315c8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:43.001411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-791259b6-d803-47e3-8e05-7a47d31315c8 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1511 microversion: 2.1 time: 0.087054 Aug 18 12:21:43.002182 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 84/164] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:42 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1511 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:43.188048 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-34d23099-c641-467f-8467-d46e4e984b1d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:43.188622 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-34d23099-c641-467f-8467-d46e4e984b1d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:43.194854 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-34d23099-c641-467f-8467-d46e4e984b1d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:43.195343 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-34d23099-c641-467f-8467-d46e4e984b1d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:43.195915 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-34d23099-c641-467f-8467-d46e4e984b1d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:43.196496 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-34d23099-c641-467f-8467-d46e4e984b1d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:43.196946 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-34d23099-c641-467f-8467-d46e4e984b1d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:43.197397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-34d23099-c641-467f-8467-d46e4e984b1d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:43.337815 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-34d23099-c641-467f-8467-d46e4e984b1d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:43.348822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=100 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:43.348822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-34d23099-c641-467f-8467-d46e4e984b1d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.162104 Aug 18 12:21:43.348822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 81/165] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:43 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:43.705751 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-78be55d1-c623-42ea-877c-09239b743471 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:43.706374 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-78be55d1-c623-42ea-877c-09239b743471 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:43.765790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-78be55d1-c623-42ea-877c-09239b743471 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:43.772730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-78be55d1-c623-42ea-877c-09239b743471 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1215 microversion: 2.1 time: 0.073289 Aug 18 12:21:43.773306 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 85/166] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:43 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:44.022169 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0e94ef58-bcbe-429c-af6e-f267b0b64e03 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:44.022786 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0e94ef58-bcbe-429c-af6e-f267b0b64e03 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:44.029688 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0e94ef58-bcbe-429c-af6e-f267b0b64e03 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:44.040009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0e94ef58-bcbe-429c-af6e-f267b0b64e03 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:44.040009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0e94ef58-bcbe-429c-af6e-f267b0b64e03 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:44.040009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0e94ef58-bcbe-429c-af6e-f267b0b64e03 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:44.040009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0e94ef58-bcbe-429c-af6e-f267b0b64e03 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:44.040798 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0e94ef58-bcbe-429c-af6e-f267b0b64e03 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:44.095566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0e94ef58-bcbe-429c-af6e-f267b0b64e03 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:44.103618 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0e94ef58-bcbe-429c-af6e-f267b0b64e03 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1346 microversion: 2.1 time: 0.085269 Aug 18 12:21:44.104190 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 82/167] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:44 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:44.367928 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d71c550a-0e9a-41e2-b9f0-ff46d3335f48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:44.369422 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d71c550a-0e9a-41e2-b9f0-ff46d3335f48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:44.377969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d71c550a-0e9a-41e2-b9f0-ff46d3335f48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:44.378680 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d71c550a-0e9a-41e2-b9f0-ff46d3335f48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:44.387510 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d71c550a-0e9a-41e2-b9f0-ff46d3335f48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:44.387510 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d71c550a-0e9a-41e2-b9f0-ff46d3335f48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:44.387510 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d71c550a-0e9a-41e2-b9f0-ff46d3335f48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:44.387510 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d71c550a-0e9a-41e2-b9f0-ff46d3335f48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:44.388114 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:44.521359 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d71c550a-0e9a-41e2-b9f0-ff46d3335f48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:44.529041 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d71c550a-0e9a-41e2-b9f0-ff46d3335f48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.165669 Aug 18 12:21:44.530247 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 86/168] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:44 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:44.792718 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8f5f30f9-4a51-44ea-9b31-aa361c46f662 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:44.793327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8f5f30f9-4a51-44ea-9b31-aa361c46f662 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:44.799580 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f5f30f9-4a51-44ea-9b31-aa361c46f662 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:44.800118 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f5f30f9-4a51-44ea-9b31-aa361c46f662 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:44.800553 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f5f30f9-4a51-44ea-9b31-aa361c46f662 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:44.801250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f5f30f9-4a51-44ea-9b31-aa361c46f662 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:44.801702 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f5f30f9-4a51-44ea-9b31-aa361c46f662 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:44.802122 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f5f30f9-4a51-44ea-9b31-aa361c46f662 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:44.880039 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8f5f30f9-4a51-44ea-9b31-aa361c46f662 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:44.887598 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8f5f30f9-4a51-44ea-9b31-aa361c46f662 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1211 microversion: 2.1 time: 0.098597 Aug 18 12:21:44.888151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 83/169] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:44 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:45.125765 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-dd9f2e73-31f2-47c2-9cd3-773fbfa0a3a0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:45.126683 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-dd9f2e73-31f2-47c2-9cd3-773fbfa0a3a0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:45.136750 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd9f2e73-31f2-47c2-9cd3-773fbfa0a3a0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:45.137287 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd9f2e73-31f2-47c2-9cd3-773fbfa0a3a0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:45.137722 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd9f2e73-31f2-47c2-9cd3-773fbfa0a3a0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:45.138409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd9f2e73-31f2-47c2-9cd3-773fbfa0a3a0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:45.139354 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd9f2e73-31f2-47c2-9cd3-773fbfa0a3a0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:45.139802 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd9f2e73-31f2-47c2-9cd3-773fbfa0a3a0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:45.203546 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-dd9f2e73-31f2-47c2-9cd3-773fbfa0a3a0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:45.211401 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-dd9f2e73-31f2-47c2-9cd3-773fbfa0a3a0 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1346 microversion: 2.1 time: 0.090074 Aug 18 12:21:45.212226 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 87/170] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:45 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:45.551824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e16ea978-06a8-445c-9f46-fb79991eb46e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:45.552424 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e16ea978-06a8-445c-9f46-fb79991eb46e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:45.558257 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e16ea978-06a8-445c-9f46-fb79991eb46e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:45.558747 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e16ea978-06a8-445c-9f46-fb79991eb46e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:45.559156 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e16ea978-06a8-445c-9f46-fb79991eb46e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:45.560042 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e16ea978-06a8-445c-9f46-fb79991eb46e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:45.560607 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e16ea978-06a8-445c-9f46-fb79991eb46e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:45.560943 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e16ea978-06a8-445c-9f46-fb79991eb46e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:45.862857 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e16ea978-06a8-445c-9f46-fb79991eb46e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:45.870796 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e16ea978-06a8-445c-9f46-fb79991eb46e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.322727 Aug 18 12:21:45.871526 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 84/171] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:45 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:45.910122 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b3537693-77f4-4038-a9f0-c85d8b7b7f54 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:45.910728 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b3537693-77f4-4038-a9f0-c85d8b7b7f54 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:45.926877 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b3537693-77f4-4038-a9f0-c85d8b7b7f54 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:45.926877 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b3537693-77f4-4038-a9f0-c85d8b7b7f54 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:45.926877 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b3537693-77f4-4038-a9f0-c85d8b7b7f54 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:45.926877 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b3537693-77f4-4038-a9f0-c85d8b7b7f54 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:45.927949 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b3537693-77f4-4038-a9f0-c85d8b7b7f54 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:45.927949 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b3537693-77f4-4038-a9f0-c85d8b7b7f54 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:45.987848 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b3537693-77f4-4038-a9f0-c85d8b7b7f54 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:45.996026 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b3537693-77f4-4038-a9f0-c85d8b7b7f54 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1275 microversion: 2.1 time: 0.090076 Aug 18 12:21:45.996786 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 88/172] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:45 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:46.236766 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:46.237405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:46.243516 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:46.243994 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:46.244884 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:46.245575 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:46.246447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:46.246868 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:46.286662 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:46.287146 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:46.287636 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:46.288086 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lazy-loading 'fault' on Instance uuid c885cd6b-b031-4755-bfc7-f597267136dd {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:21:46.352951 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a830bd2267f948f693c6b211293c6b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95d3e9a225f45a88b06bee262207b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:46.369015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4b941f4f-55f0-4c27-8e11-d8c6e1c1cc80 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 200 len: 1351 microversion: 2.1 time: 0.139547 Aug 18 12:21:46.369991 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 85/173] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:46 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 1351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:46.893454 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-bdcf742c-5785-4ad1-8493-68fe1d35ae27 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:46.894489 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-bdcf742c-5785-4ad1-8493-68fe1d35ae27 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:46.902157 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bdcf742c-5785-4ad1-8493-68fe1d35ae27 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:46.903032 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bdcf742c-5785-4ad1-8493-68fe1d35ae27 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:46.903681 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bdcf742c-5785-4ad1-8493-68fe1d35ae27 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:46.904655 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bdcf742c-5785-4ad1-8493-68fe1d35ae27 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:46.905262 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bdcf742c-5785-4ad1-8493-68fe1d35ae27 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:46.905988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bdcf742c-5785-4ad1-8493-68fe1d35ae27 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:47.017285 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-39ef8378-433c-4308-86c8-9e164b7495b1 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:47.018038 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-39ef8378-433c-4308-86c8-9e164b7495b1 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:47.024376 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39ef8378-433c-4308-86c8-9e164b7495b1 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:47.024864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39ef8378-433c-4308-86c8-9e164b7495b1 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:47.025519 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39ef8378-433c-4308-86c8-9e164b7495b1 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:47.026402 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39ef8378-433c-4308-86c8-9e164b7495b1 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:47.026847 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39ef8378-433c-4308-86c8-9e164b7495b1 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:47.027275 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39ef8378-433c-4308-86c8-9e164b7495b1 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:47.054592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bdcf742c-5785-4ad1-8493-68fe1d35ae27 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:47.073266 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-bdcf742c-5785-4ad1-8493-68fe1d35ae27 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.184950 Aug 18 12:21:47.073852 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 89/174] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:46 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:47.237302 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-39ef8378-433c-4308-86c8-9e164b7495b1 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:47.246559 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-39ef8378-433c-4308-86c8-9e164b7495b1 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.233174 Aug 18 12:21:47.259999 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 86/175] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:47 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:47.394581 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:47.395192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:47.402647 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:47.403133 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:47.403598 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:47.404979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:47.405388 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:47.406200 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] HTTP exception thrown: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Request method failure captured: Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd HTTP/1.1 Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i6QW5ag-7wXJWPrMchvA5OJUkN4It5YNJOtvPOEtrUMSl9HlRSlKkB8jhu-rNrWiVLea9hiWeutwbLMijymtriMX79RgztcbagEt0LaxltA_02XKV30eMn8KZI4el9mt1_W9XOtLNdvc-E4_l2T3xaVlQLNkNvfh_V8TaNo-o7QvGM Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: a95d3e9a225f45a88b06bee262207b6c Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:21:47.431566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: a95d3e9a225f45a88b06bee262207b6c Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-DeleteServersTestJSON-1224186809-project Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: a830bd2267f948f693c6b211293c6b89 Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-DeleteServersTestJSON-1224186809-project Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:47.432762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': 'c885cd6b-b031-4755-bfc7-f597267136dd'} Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:21:47.433436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:47.434724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:21:47.436157 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Returning 404 to user: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:21:47.436157 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5373a7f9-6c38-46d8-a6bc-e8a74c21a969 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 404 len: 111 microversion: 2.1 time: 0.036812 Aug 18 12:21:47.436157 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 90/176] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:47 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:21:47.555930 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:47.558222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:47.565004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:47.565479 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:47.565906 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:47.566587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:47.567083 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:47.567479 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:47.582705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] HTTP exception thrown: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Request method failure captured: Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd/os-volume_attachments HTTP/1.1 Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i6QW5ag-7wXJWPrMchvA5OJUkN4It5YNJOtvPOEtrUMSl9HlRSlKkB8jhu-rNrWiVLea9hiWeutwbLMijymtriMX79RgztcbagEt0LaxltA_02XKV30eMn8KZI4el9mt1_W9XOtLNdvc-E4_l2T3xaVlQLNkNvfh_V8TaNo-o7QvGM Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: a95d3e9a225f45a88b06bee262207b6c Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:21:47.587801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: a95d3e9a225f45a88b06bee262207b6c Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-DeleteServersTestJSON-1224186809-project Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: a830bd2267f948f693c6b211293c6b89 Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-DeleteServersTestJSON-1224186809-project Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:47.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'server_id': 'c885cd6b-b031-4755-bfc7-f597267136dd'} Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:21:47.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:47.591300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:21:47.592665 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Returning 404 to user: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:21:47.592665 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f6ceb6ba-57c8-45b1-9c81-b0a2a3f29a83 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037354 Aug 18 12:21:47.592665 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 87/177] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:21:47 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:21:48.101483 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-09098c09-edee-4943-846c-1fdcb4aaf8be tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:48.101483 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-09098c09-edee-4943-846c-1fdcb4aaf8be tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:48.102008 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-09098c09-edee-4943-846c-1fdcb4aaf8be tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:48.102198 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-09098c09-edee-4943-846c-1fdcb4aaf8be tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:48.102625 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-09098c09-edee-4943-846c-1fdcb4aaf8be tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:48.103305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-09098c09-edee-4943-846c-1fdcb4aaf8be tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:48.103775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-09098c09-edee-4943-846c-1fdcb4aaf8be tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:48.104191 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-09098c09-edee-4943-846c-1fdcb4aaf8be tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:48.237296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-09098c09-edee-4943-846c-1fdcb4aaf8be tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:48.245602 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-09098c09-edee-4943-846c-1fdcb4aaf8be tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.155371 Aug 18 12:21:48.246171 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 91/178] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:48 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:48.268313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7228b0bb-ec95-41ed-a05d-911f910bcc2b tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:48.268840 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7228b0bb-ec95-41ed-a05d-911f910bcc2b tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:48.274855 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7228b0bb-ec95-41ed-a05d-911f910bcc2b tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:48.275318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7228b0bb-ec95-41ed-a05d-911f910bcc2b tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:48.275802 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7228b0bb-ec95-41ed-a05d-911f910bcc2b tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:48.276476 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7228b0bb-ec95-41ed-a05d-911f910bcc2b tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:48.276915 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7228b0bb-ec95-41ed-a05d-911f910bcc2b tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:48.277330 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7228b0bb-ec95-41ed-a05d-911f910bcc2b tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:48.480849 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7228b0bb-ec95-41ed-a05d-911f910bcc2b tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:48.488348 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7228b0bb-ec95-41ed-a05d-911f910bcc2b tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.224535 Aug 18 12:21:48.489111 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 88/179] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:48 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:49.082699 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-826a7ba4-2c92-4a0b-9b0a-a0fb46503ea9 req-1f6d6d9c-005a-474d-a6f4-2d04fab7c4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c630629-baab-41d4-be06-ae0784a8b93e", "tag": "adcb7fb2-bc8e-479f-8492-1e55ade7a8cc"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:49.093366 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-826a7ba4-2c92-4a0b-9b0a-a0fb46503ea9 req-1f6d6d9c-005a-474d-a6f4-2d04fab7c4bc service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:49.093959 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-826a7ba4-2c92-4a0b-9b0a-a0fb46503ea9 req-1f6d6d9c-005a-474d-a6f4-2d04fab7c4bc service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:49.094393 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-826a7ba4-2c92-4a0b-9b0a-a0fb46503ea9 req-1f6d6d9c-005a-474d-a6f4-2d04fab7c4bc service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:49.105915 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-826a7ba4-2c92-4a0b-9b0a-a0fb46503ea9 req-1f6d6d9c-005a-474d-a6f4-2d04fab7c4bc service nova] Creating event network-changed:adcb7fb2-bc8e-479f-8492-1e55ade7a8cc for instance 8c630629-baab-41d4-be06-ae0784a8b93e on hv-cinder-83602 Aug 18 12:21:49.112177 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-826a7ba4-2c92-4a0b-9b0a-a0fb46503ea9 req-1f6d6d9c-005a-474d-a6f4-2d04fab7c4bc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033669 Aug 18 12:21:49.112851 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 92/180] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:21:49.266444 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-15a6f69b-6ce5-4184-ae11-3dc1420e5522 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:49.267201 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-15a6f69b-6ce5-4184-ae11-3dc1420e5522 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:49.273192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15a6f69b-6ce5-4184-ae11-3dc1420e5522 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:49.273816 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15a6f69b-6ce5-4184-ae11-3dc1420e5522 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:49.274077 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15a6f69b-6ce5-4184-ae11-3dc1420e5522 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:49.274945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15a6f69b-6ce5-4184-ae11-3dc1420e5522 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:49.275390 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15a6f69b-6ce5-4184-ae11-3dc1420e5522 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:49.275916 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15a6f69b-6ce5-4184-ae11-3dc1420e5522 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:49.510756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6504cf36-ef20-4b25-9600-4626684cd719 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:49.511479 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-6504cf36-ef20-4b25-9600-4626684cd719 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:49.518279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6504cf36-ef20-4b25-9600-4626684cd719 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:49.518800 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6504cf36-ef20-4b25-9600-4626684cd719 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:49.519226 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6504cf36-ef20-4b25-9600-4626684cd719 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:49.519949 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6504cf36-ef20-4b25-9600-4626684cd719 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:49.520405 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6504cf36-ef20-4b25-9600-4626684cd719 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:49.520826 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6504cf36-ef20-4b25-9600-4626684cd719 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:49.582340 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-15a6f69b-6ce5-4184-ae11-3dc1420e5522 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:49.591658 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-15a6f69b-6ce5-4184-ae11-3dc1420e5522 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.328156 Aug 18 12:21:49.592535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 89/181] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:49 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:49.661326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6504cf36-ef20-4b25-9600-4626684cd719 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:49.669044 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6504cf36-ef20-4b25-9600-4626684cd719 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.162990 Aug 18 12:21:49.669590 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 93/182] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:49 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:50.613832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f7fcbd87-0835-4187-8f8f-041224f08f02 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:50.614461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f7fcbd87-0835-4187-8f8f-041224f08f02 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:50.623403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f7fcbd87-0835-4187-8f8f-041224f08f02 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:50.626655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f7fcbd87-0835-4187-8f8f-041224f08f02 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:50.627148 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f7fcbd87-0835-4187-8f8f-041224f08f02 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:50.627939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f7fcbd87-0835-4187-8f8f-041224f08f02 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:50.628400 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f7fcbd87-0835-4187-8f8f-041224f08f02 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:50.628822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f7fcbd87-0835-4187-8f8f-041224f08f02 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:50.690404 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3f519cfe-d76a-403a-a08f-f4c7132dc955 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:50.691489 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3f519cfe-d76a-403a-a08f-f4c7132dc955 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:50.701146 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3f519cfe-d76a-403a-a08f-f4c7132dc955 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:50.701696 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3f519cfe-d76a-403a-a08f-f4c7132dc955 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:50.702292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3f519cfe-d76a-403a-a08f-f4c7132dc955 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:50.703261 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3f519cfe-d76a-403a-a08f-f4c7132dc955 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:50.704037 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3f519cfe-d76a-403a-a08f-f4c7132dc955 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:50.704547 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3f519cfe-d76a-403a-a08f-f4c7132dc955 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:50.774851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f7fcbd87-0835-4187-8f8f-041224f08f02 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:50.783907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f7fcbd87-0835-4187-8f8f-041224f08f02 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.174201 Aug 18 12:21:50.784510 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 90/183] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:50 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:50.850389 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3f519cfe-d76a-403a-a08f-f4c7132dc955 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:50.859834 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3f519cfe-d76a-403a-a08f-f4c7132dc955 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.174175 Aug 18 12:21:50.872024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 94/184] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:50 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:51.804839 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bd34551e-f1d2-4246-b603-cc489d551f0d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:51.805449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bd34551e-f1d2-4246-b603-cc489d551f0d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:51.812077 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd34551e-f1d2-4246-b603-cc489d551f0d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:51.812558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd34551e-f1d2-4246-b603-cc489d551f0d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:51.813019 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd34551e-f1d2-4246-b603-cc489d551f0d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:51.813704 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd34551e-f1d2-4246-b603-cc489d551f0d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:51.814153 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd34551e-f1d2-4246-b603-cc489d551f0d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:51.814568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd34551e-f1d2-4246-b603-cc489d551f0d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:51.881553 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-576b833d-d72b-4d67-a5ed-fe9bb2fdf0a7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:51.882125 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-576b833d-d72b-4d67-a5ed-fe9bb2fdf0a7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:51.888549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-576b833d-d72b-4d67-a5ed-fe9bb2fdf0a7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:51.889027 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-576b833d-d72b-4d67-a5ed-fe9bb2fdf0a7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:51.889514 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-576b833d-d72b-4d67-a5ed-fe9bb2fdf0a7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:51.890207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-576b833d-d72b-4d67-a5ed-fe9bb2fdf0a7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:51.890666 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-576b833d-d72b-4d67-a5ed-fe9bb2fdf0a7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:51.891085 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-576b833d-d72b-4d67-a5ed-fe9bb2fdf0a7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:51.951746 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bd34551e-f1d2-4246-b603-cc489d551f0d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:51.959292 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-bd34551e-f1d2-4246-b603-cc489d551f0d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.158226 Aug 18 12:21:51.959980 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 91/185] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:51 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:52.024833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-576b833d-d72b-4d67-a5ed-fe9bb2fdf0a7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:52.033069 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-576b833d-d72b-4d67-a5ed-fe9bb2fdf0a7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.155482 Aug 18 12:21:52.033638 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 95/186] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:51 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:52.980465 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-24ac5931-9b79-4f66-9256-908f5b3101dd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:52.981080 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-24ac5931-9b79-4f66-9256-908f5b3101dd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:52.982879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:52.988113 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24ac5931-9b79-4f66-9256-908f5b3101dd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:52.988583 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24ac5931-9b79-4f66-9256-908f5b3101dd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:52.989005 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24ac5931-9b79-4f66-9256-908f5b3101dd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:52.989680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24ac5931-9b79-4f66-9256-908f5b3101dd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:52.990124 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24ac5931-9b79-4f66-9256-908f5b3101dd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:52.990542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24ac5931-9b79-4f66-9256-908f5b3101dd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:53.054744 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ac88cb76-0e7f-4dec-ba39-555d155f9d4f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:53.055293 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ac88cb76-0e7f-4dec-ba39-555d155f9d4f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:53.057333 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:53.062805 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac88cb76-0e7f-4dec-ba39-555d155f9d4f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:53.063964 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac88cb76-0e7f-4dec-ba39-555d155f9d4f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:53.064105 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac88cb76-0e7f-4dec-ba39-555d155f9d4f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:53.064759 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac88cb76-0e7f-4dec-ba39-555d155f9d4f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:53.065208 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac88cb76-0e7f-4dec-ba39-555d155f9d4f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:53.065632 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac88cb76-0e7f-4dec-ba39-555d155f9d4f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:53.122984 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-24ac5931-9b79-4f66-9256-908f5b3101dd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:53.130708 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-24ac5931-9b79-4f66-9256-908f5b3101dd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.154091 Aug 18 12:21:53.131311 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 92/187] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:52 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:53.198483 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ac88cb76-0e7f-4dec-ba39-555d155f9d4f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:53.206589 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ac88cb76-0e7f-4dec-ba39-555d155f9d4f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.155781 Aug 18 12:21:53.207149 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 96/188] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:53 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:54.152039 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-da8b6adc-8459-4ffc-a237-fbb3803f6ed4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:54.152554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-da8b6adc-8459-4ffc-a237-fbb3803f6ed4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:54.159972 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8b6adc-8459-4ffc-a237-fbb3803f6ed4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:54.160454 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8b6adc-8459-4ffc-a237-fbb3803f6ed4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:54.160891 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8b6adc-8459-4ffc-a237-fbb3803f6ed4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:54.161580 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8b6adc-8459-4ffc-a237-fbb3803f6ed4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:54.162025 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8b6adc-8459-4ffc-a237-fbb3803f6ed4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:54.162479 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8b6adc-8459-4ffc-a237-fbb3803f6ed4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:54.227496 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5f0732e6-7a24-4f5a-b1af-776a7362ab19 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:54.228105 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5f0732e6-7a24-4f5a-b1af-776a7362ab19 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:54.229971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=8 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:54.235162 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5f0732e6-7a24-4f5a-b1af-776a7362ab19 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:54.235687 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5f0732e6-7a24-4f5a-b1af-776a7362ab19 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:54.236123 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5f0732e6-7a24-4f5a-b1af-776a7362ab19 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:54.236820 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5f0732e6-7a24-4f5a-b1af-776a7362ab19 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:54.237270 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5f0732e6-7a24-4f5a-b1af-776a7362ab19 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:54.237690 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5f0732e6-7a24-4f5a-b1af-776a7362ab19 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:54.305570 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-da8b6adc-8459-4ffc-a237-fbb3803f6ed4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:54.314613 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-da8b6adc-8459-4ffc-a237-fbb3803f6ed4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.166477 Aug 18 12:21:54.315674 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 93/189] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:54 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:54.370393 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:54.371136 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:54.380084 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:54.380788 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:54.381333 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:54.382283 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:54.382841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:54.383369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:54.388414 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5f0732e6-7a24-4f5a-b1af-776a7362ab19 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:54.396592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5f0732e6-7a24-4f5a-b1af-776a7362ab19 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.172918 Aug 18 12:21:54.397169 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 97/190] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:54 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:54.401337 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] HTTP exception thrown: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Request method failure captured: Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: DELETE /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd HTTP/1.1 Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i6QW5ag-7wXJWPrMchvA5OJUkN4It5YNJOtvPOEtrUMSl9HlRSlKkB8jhu-rNrWiVLea9hiWeutwbLMijymtriMX79RgztcbagEt0LaxltA_02XKV30eMn8KZI4el9mt1_W9XOtLNdvc-E4_l2T3xaVlQLNkNvfh_V8TaNo-o7QvGM Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: a95d3e9a225f45a88b06bee262207b6c Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:21:54.403745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: a95d3e9a225f45a88b06bee262207b6c Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-DeleteServersTestJSON-1224186809-project Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: a830bd2267f948f693c6b211293c6b89 Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-DeleteServersTestJSON-1224186809-project Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:54.405405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': 'c885cd6b-b031-4755-bfc7-f597267136dd'} Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:21:54.406252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:54.407546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:21:54.408866 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Returning 404 to user: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:21:54.408866 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8aab4aed-9d17-404f-9837-8071804b79fe tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 404 len: 111 microversion: 2.1 time: 0.041446 Aug 18 12:21:54.409147 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 94/191] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:21:54 2022] DELETE /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:21:54.416779 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:54.417480 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] [instance: c885cd6b-b031-4755-bfc7-f597267136dd] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:54.423629 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:54.424358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:54.424796 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:54.425481 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:54.425935 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:54.426355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:54.440407 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] HTTP exception thrown: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Request method failure captured: Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd HTTP/1.1 Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i6QW5ag-7wXJWPrMchvA5OJUkN4It5YNJOtvPOEtrUMSl9HlRSlKkB8jhu-rNrWiVLea9hiWeutwbLMijymtriMX79RgztcbagEt0LaxltA_02XKV30eMn8KZI4el9mt1_W9XOtLNdvc-E4_l2T3xaVlQLNkNvfh_V8TaNo-o7QvGM Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: a95d3e9a225f45a88b06bee262207b6c Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:21:54.442040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a95d3e9a225f45a88b06bee262207b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: a95d3e9a225f45a88b06bee262207b6c Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-DeleteServersTestJSON-1224186809 Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-DeleteServersTestJSON-1224186809-project Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: a830bd2267f948f693c6b211293c6b89 Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-DeleteServersTestJSON-1224186809-project Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:54.443541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': 'c885cd6b-b031-4755-bfc7-f597267136dd'} Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:21:54.444635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. Aug 18 12:21:54.445884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:21:54.447222 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] Returning 404 to user: Instance c885cd6b-b031-4755-bfc7-f597267136dd could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:21:54.447222 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-597e05a8-83de-4429-b8e6-d09aa775b6b7 tempest-DeleteServersTestJSON-1224186809 tempest-DeleteServersTestJSON-1224186809-project] 10.222.0.98 "GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd" status: 404 len: 111 microversion: 2.1 time: 0.030470 Aug 18 12:21:54.447222 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 98/192] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:54 2022] GET /compute/v2.1/servers/c885cd6b-b031-4755-bfc7-f597267136dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:21:55.337941 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1f2fd010-d188-464c-97d2-7bfd8c3a7b39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:55.338680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1f2fd010-d188-464c-97d2-7bfd8c3a7b39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:55.345012 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1f2fd010-d188-464c-97d2-7bfd8c3a7b39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:55.348253 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1f2fd010-d188-464c-97d2-7bfd8c3a7b39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:55.348253 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1f2fd010-d188-464c-97d2-7bfd8c3a7b39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:55.348253 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1f2fd010-d188-464c-97d2-7bfd8c3a7b39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:55.348253 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1f2fd010-d188-464c-97d2-7bfd8c3a7b39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:55.348664 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1f2fd010-d188-464c-97d2-7bfd8c3a7b39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:55.417437 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c15505e0-bd4a-4c96-b067-1307f648bbda tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:55.418659 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c15505e0-bd4a-4c96-b067-1307f648bbda tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:55.425769 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c15505e0-bd4a-4c96-b067-1307f648bbda tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:55.426549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c15505e0-bd4a-4c96-b067-1307f648bbda tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:55.427192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c15505e0-bd4a-4c96-b067-1307f648bbda tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:55.427913 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c15505e0-bd4a-4c96-b067-1307f648bbda tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:55.428573 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c15505e0-bd4a-4c96-b067-1307f648bbda tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:55.429169 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c15505e0-bd4a-4c96-b067-1307f648bbda tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:55.527786 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1f2fd010-d188-464c-97d2-7bfd8c3a7b39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:55.539445 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1f2fd010-d188-464c-97d2-7bfd8c3a7b39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.205193 Aug 18 12:21:55.540032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 95/193] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:55 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:55.603505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c15505e0-bd4a-4c96-b067-1307f648bbda tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:55.612297 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c15505e0-bd4a-4c96-b067-1307f648bbda tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.199192 Aug 18 12:21:55.618406 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 99/194] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:55 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:56.569027 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fc7f40d3-a47a-4538-b4ed-a40c0041e2ec tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:56.569645 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fc7f40d3-a47a-4538-b4ed-a40c0041e2ec tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:56.581103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc7f40d3-a47a-4538-b4ed-a40c0041e2ec tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:56.581626 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc7f40d3-a47a-4538-b4ed-a40c0041e2ec tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:56.582021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc7f40d3-a47a-4538-b4ed-a40c0041e2ec tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:56.582751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc7f40d3-a47a-4538-b4ed-a40c0041e2ec tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:56.585061 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc7f40d3-a47a-4538-b4ed-a40c0041e2ec tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:56.585787 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc7f40d3-a47a-4538-b4ed-a40c0041e2ec tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:56.636550 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-9b8bab09-8916-4da6-b41c-270c4a18e4cd tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:56.637169 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-9b8bab09-8916-4da6-b41c-270c4a18e4cd tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:56.647861 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9b8bab09-8916-4da6-b41c-270c4a18e4cd tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:56.649168 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9b8bab09-8916-4da6-b41c-270c4a18e4cd tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:56.650238 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9b8bab09-8916-4da6-b41c-270c4a18e4cd tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:56.651717 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9b8bab09-8916-4da6-b41c-270c4a18e4cd tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:56.652549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9b8bab09-8916-4da6-b41c-270c4a18e4cd tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:56.653111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9b8bab09-8916-4da6-b41c-270c4a18e4cd tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:56.817016 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fc7f40d3-a47a-4538-b4ed-a40c0041e2ec tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:56.855340 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fc7f40d3-a47a-4538-b4ed-a40c0041e2ec tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1523 microversion: 2.1 time: 0.290009 Aug 18 12:21:56.858748 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 96/195] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:56 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:56.926439 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-9b8bab09-8916-4da6-b41c-270c4a18e4cd tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:56.946589 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-9b8bab09-8916-4da6-b41c-270c4a18e4cd tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.316944 Aug 18 12:21:56.959577 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 100/196] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:56 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:57.877687 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-38d4b92e-0d1e-42ab-ac09-9fea17c1221a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:57.878219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-38d4b92e-0d1e-42ab-ac09-9fea17c1221a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:57.889654 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-38d4b92e-0d1e-42ab-ac09-9fea17c1221a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:57.893993 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-38d4b92e-0d1e-42ab-ac09-9fea17c1221a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:57.893993 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-38d4b92e-0d1e-42ab-ac09-9fea17c1221a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:57.893993 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-38d4b92e-0d1e-42ab-ac09-9fea17c1221a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:57.893993 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-38d4b92e-0d1e-42ab-ac09-9fea17c1221a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:57.894700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-38d4b92e-0d1e-42ab-ac09-9fea17c1221a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:57.971547 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8fdc8586-7aae-4be3-bd6c-fc54af1ea75a tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:57.972167 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8fdc8586-7aae-4be3-bd6c-fc54af1ea75a tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:57.980641 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fdc8586-7aae-4be3-bd6c-fc54af1ea75a tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:57.981129 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fdc8586-7aae-4be3-bd6c-fc54af1ea75a tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:57.981566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fdc8586-7aae-4be3-bd6c-fc54af1ea75a tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:57.987759 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fdc8586-7aae-4be3-bd6c-fc54af1ea75a tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:57.988256 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fdc8586-7aae-4be3-bd6c-fc54af1ea75a tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:57.988687 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8fdc8586-7aae-4be3-bd6c-fc54af1ea75a tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:58.245643 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8fdc8586-7aae-4be3-bd6c-fc54af1ea75a tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:58.256204 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8fdc8586-7aae-4be3-bd6c-fc54af1ea75a tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.287838 Aug 18 12:21:58.272530 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 101/197] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:57 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:58.293995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-38d4b92e-0d1e-42ab-ac09-9fea17c1221a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:58.306359 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-38d4b92e-0d1e-42ab-ac09-9fea17c1221a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1503 microversion: 2.1 time: 0.433006 Aug 18 12:21:58.307344 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 97/198] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:57 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1503 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:58.331279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-61286676-6e9b-499c-a578-6f1d0c12ccb3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:58.331279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-61286676-6e9b-499c-a578-6f1d0c12ccb3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:58.333377 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61286676-6e9b-499c-a578-6f1d0c12ccb3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:58.333849 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61286676-6e9b-499c-a578-6f1d0c12ccb3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:58.334271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61286676-6e9b-499c-a578-6f1d0c12ccb3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:58.334958 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61286676-6e9b-499c-a578-6f1d0c12ccb3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:58.335406 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61286676-6e9b-499c-a578-6f1d0c12ccb3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:58.335840 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61286676-6e9b-499c-a578-6f1d0c12ccb3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:58.596105 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-61286676-6e9b-499c-a578-6f1d0c12ccb3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:58.605659 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-61286676-6e9b-499c-a578-6f1d0c12ccb3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1517 microversion: 2.1 time: 0.282782 Aug 18 12:21:58.610354 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 102/199] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:58 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1517 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:59.139084 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-8f6d0e8d-824e-4746-b1b7-6d40b745ee6c req-dd9973b7-02ec-4fc1-aef4-1a690c253525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c630629-baab-41d4-be06-ae0784a8b93e", "name": "network-vif-plugged", "status": "completed", "tag": "adcb7fb2-bc8e-479f-8492-1e55ade7a8cc"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:59.157963 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-8f6d0e8d-824e-4746-b1b7-6d40b745ee6c req-dd9973b7-02ec-4fc1-aef4-1a690c253525 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:59.158582 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-8f6d0e8d-824e-4746-b1b7-6d40b745ee6c req-dd9973b7-02ec-4fc1-aef4-1a690c253525 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:59.159088 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-8f6d0e8d-824e-4746-b1b7-6d40b745ee6c req-dd9973b7-02ec-4fc1-aef4-1a690c253525 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:59.174021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-8f6d0e8d-824e-4746-b1b7-6d40b745ee6c req-dd9973b7-02ec-4fc1-aef4-1a690c253525 service nova] Creating event network-vif-plugged:adcb7fb2-bc8e-479f-8492-1e55ade7a8cc for instance 8c630629-baab-41d4-be06-ae0784a8b93e on hv-cinder-83602 Aug 18 12:21:59.180866 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-8f6d0e8d-824e-4746-b1b7-6d40b745ee6c req-dd9973b7-02ec-4fc1-aef4-1a690c253525 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048331 Aug 18 12:21:59.181782 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 98/200] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:21:59.278194 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b9f62753-3c08-403b-ac0e-7b90711f061e tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:59.280126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b9f62753-3c08-403b-ac0e-7b90711f061e tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:59.290857 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9f62753-3c08-403b-ac0e-7b90711f061e tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:59.291354 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9f62753-3c08-403b-ac0e-7b90711f061e tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:59.291817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9f62753-3c08-403b-ac0e-7b90711f061e tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:59.292522 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9f62753-3c08-403b-ac0e-7b90711f061e tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:59.292971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9f62753-3c08-403b-ac0e-7b90711f061e tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:59.293455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b9f62753-3c08-403b-ac0e-7b90711f061e tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:59.565204 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b9f62753-3c08-403b-ac0e-7b90711f061e tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:59.574224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b9f62753-3c08-403b-ac0e-7b90711f061e tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.299845 Aug 18 12:21:59.610609 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 103/201] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:59 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:00.602436 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-021fe266-b0ad-4356-a0af-6e2b587d284f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:00.603150 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-021fe266-b0ad-4356-a0af-6e2b587d284f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:00.609331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-021fe266-b0ad-4356-a0af-6e2b587d284f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:00.609808 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-021fe266-b0ad-4356-a0af-6e2b587d284f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:00.610264 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-021fe266-b0ad-4356-a0af-6e2b587d284f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:00.610951 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-021fe266-b0ad-4356-a0af-6e2b587d284f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:00.611533 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-021fe266-b0ad-4356-a0af-6e2b587d284f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:00.611948 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-021fe266-b0ad-4356-a0af-6e2b587d284f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:00.744528 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3837dd3a-553b-4dab-9394-b4826889fc26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:00.764502 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3837dd3a-553b-4dab-9394-b4826889fc26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:00.775873 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3837dd3a-553b-4dab-9394-b4826889fc26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:00.777035 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3837dd3a-553b-4dab-9394-b4826889fc26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:00.777801 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3837dd3a-553b-4dab-9394-b4826889fc26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:00.779102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3837dd3a-553b-4dab-9394-b4826889fc26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:00.779874 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3837dd3a-553b-4dab-9394-b4826889fc26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:00.780488 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3837dd3a-553b-4dab-9394-b4826889fc26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:00.791030 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-021fe266-b0ad-4356-a0af-6e2b587d284f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:00.800816 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-021fe266-b0ad-4356-a0af-6e2b587d284f tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1315 microversion: 2.1 time: 0.203497 Aug 18 12:22:00.814835 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-3837dd3a-553b-4dab-9394-b4826889fc26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lazy-loading 'flavor' on Instance uuid 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:22:00.815941 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 99/202] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:00 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:00.843080 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=100 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:01.226208 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3837dd3a-553b-4dab-9394-b4826889fc26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "POST /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2/action" status: 200 len: 32 microversion: 2.1 time: 0.487285 Aug 18 12:22:01.227079 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 104/203] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:22:00 2022] POST /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2/action => generated 32 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 12:22:01.237085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fbca0bd9-b670-4e33-ba9b-bcaee1629aaa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:01.238134 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fbca0bd9-b670-4e33-ba9b-bcaee1629aaa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:01.244863 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fbca0bd9-b670-4e33-ba9b-bcaee1629aaa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:01.245698 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fbca0bd9-b670-4e33-ba9b-bcaee1629aaa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:01.260288 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fbca0bd9-b670-4e33-ba9b-bcaee1629aaa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:01.260288 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fbca0bd9-b670-4e33-ba9b-bcaee1629aaa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:01.264578 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fbca0bd9-b670-4e33-ba9b-bcaee1629aaa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:01.265421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fbca0bd9-b670-4e33-ba9b-bcaee1629aaa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:01.273145 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=100 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:01.500571 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fbca0bd9-b670-4e33-ba9b-bcaee1629aaa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:01.508032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fbca0bd9-b670-4e33-ba9b-bcaee1629aaa tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.275449 Aug 18 12:22:01.508595 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 100/204] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:01 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:01.825186 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6e0ba94f-1dfa-4d90-b6f1-1b2e72603f52 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:01.826552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-6e0ba94f-1dfa-4d90-b6f1-1b2e72603f52 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:01.838219 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e0ba94f-1dfa-4d90-b6f1-1b2e72603f52 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:01.839930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e0ba94f-1dfa-4d90-b6f1-1b2e72603f52 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:01.840625 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e0ba94f-1dfa-4d90-b6f1-1b2e72603f52 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:01.841689 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e0ba94f-1dfa-4d90-b6f1-1b2e72603f52 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:01.842255 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e0ba94f-1dfa-4d90-b6f1-1b2e72603f52 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:01.842861 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e0ba94f-1dfa-4d90-b6f1-1b2e72603f52 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:02.018535 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6e0ba94f-1dfa-4d90-b6f1-1b2e72603f52 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:02.027622 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6e0ba94f-1dfa-4d90-b6f1-1b2e72603f52 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1465 microversion: 2.1 time: 0.208174 Aug 18 12:22:02.028427 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 105/205] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:01 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1465 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:02.080265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0781cf55-681a-4c74-af21-452fb78071e3 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:02.080779 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0781cf55-681a-4c74-af21-452fb78071e3 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:02.087371 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0781cf55-681a-4c74-af21-452fb78071e3 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:02.087936 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0781cf55-681a-4c74-af21-452fb78071e3 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:02.095876 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0781cf55-681a-4c74-af21-452fb78071e3 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:02.101255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0781cf55-681a-4c74-af21-452fb78071e3 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:02.101857 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0781cf55-681a-4c74-af21-452fb78071e3 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:02.102578 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0781cf55-681a-4c74-af21-452fb78071e3 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:02.135839 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0781cf55-681a-4c74-af21-452fb78071e3 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:22:02.538208 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f49fb520-0ea7-4650-870e-76c3dc7dcb94 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:02.538927 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f49fb520-0ea7-4650-870e-76c3dc7dcb94 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:02.545338 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f49fb520-0ea7-4650-870e-76c3dc7dcb94 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:02.545832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f49fb520-0ea7-4650-870e-76c3dc7dcb94 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:02.546274 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f49fb520-0ea7-4650-870e-76c3dc7dcb94 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:02.547060 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f49fb520-0ea7-4650-870e-76c3dc7dcb94 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:02.547538 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f49fb520-0ea7-4650-870e-76c3dc7dcb94 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:02.548163 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f49fb520-0ea7-4650-870e-76c3dc7dcb94 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:02.567699 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0781cf55-681a-4c74-af21-452fb78071e3 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 204 len: 0 microversion: 2.1 time: 0.491048 Aug 18 12:22:02.568728 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 101/206] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:22:02 2022] DELETE /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:22:02.578738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-47764e7b-78bd-44d5-b4b3-e70bc45641da tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:02.580006 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-47764e7b-78bd-44d5-b4b3-e70bc45641da tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:02.589866 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-47764e7b-78bd-44d5-b4b3-e70bc45641da tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:02.590337 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-47764e7b-78bd-44d5-b4b3-e70bc45641da tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:02.590941 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-47764e7b-78bd-44d5-b4b3-e70bc45641da tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:02.591878 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-47764e7b-78bd-44d5-b4b3-e70bc45641da tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:02.592331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-47764e7b-78bd-44d5-b4b3-e70bc45641da tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:02.592776 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-47764e7b-78bd-44d5-b4b3-e70bc45641da tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:02.737209 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f49fb520-0ea7-4650-870e-76c3dc7dcb94 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:02.745169 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f49fb520-0ea7-4650-870e-76c3dc7dcb94 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.214987 Aug 18 12:22:02.746035 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 106/207] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:02 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:02.770584 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-47764e7b-78bd-44d5-b4b3-e70bc45641da tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:02.770584 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-47764e7b-78bd-44d5-b4b3-e70bc45641da tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1471 microversion: 2.1 time: 0.191319 Aug 18 12:22:02.770584 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 102/208] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:02 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:03.770249 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3c318b33-4361-42db-a95a-17730c0cf712 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:03.773582 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3c318b33-4361-42db-a95a-17730c0cf712 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:03.787331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e8d43178-cbfc-47c0-8eda-a069f8aa8e21 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:03.788171 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e8d43178-cbfc-47c0-8eda-a069f8aa8e21 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:03.796097 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c318b33-4361-42db-a95a-17730c0cf712 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:03.797124 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c318b33-4361-42db-a95a-17730c0cf712 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:03.797562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c318b33-4361-42db-a95a-17730c0cf712 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:03.798277 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c318b33-4361-42db-a95a-17730c0cf712 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:03.857213 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c318b33-4361-42db-a95a-17730c0cf712 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:03.858477 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:03.858477 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8d43178-cbfc-47c0-8eda-a069f8aa8e21 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:03.858477 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8d43178-cbfc-47c0-8eda-a069f8aa8e21 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:03.859524 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c318b33-4361-42db-a95a-17730c0cf712 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:03.859883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8d43178-cbfc-47c0-8eda-a069f8aa8e21 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:03.859883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8d43178-cbfc-47c0-8eda-a069f8aa8e21 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:03.859883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8d43178-cbfc-47c0-8eda-a069f8aa8e21 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:03.859883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8d43178-cbfc-47c0-8eda-a069f8aa8e21 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:04.020832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3c318b33-4361-42db-a95a-17730c0cf712 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:04.020832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3c318b33-4361-42db-a95a-17730c0cf712 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.241518 Aug 18 12:22:04.020832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 107/209] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:03 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:04.033268 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e8d43178-cbfc-47c0-8eda-a069f8aa8e21 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:04.041587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e8d43178-cbfc-47c0-8eda-a069f8aa8e21 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1471 microversion: 2.1 time: 0.258889 Aug 18 12:22:04.042282 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 103/210] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:03 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1471 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:05.039330 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0553f078-0f6e-4726-96d9-6d7518652354 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:05.041060 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0553f078-0f6e-4726-96d9-6d7518652354 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:05.050905 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:05.052994 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0553f078-0f6e-4726-96d9-6d7518652354 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:05.053680 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0553f078-0f6e-4726-96d9-6d7518652354 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:05.054324 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0553f078-0f6e-4726-96d9-6d7518652354 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:05.055219 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0553f078-0f6e-4726-96d9-6d7518652354 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:05.056039 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0553f078-0f6e-4726-96d9-6d7518652354 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:05.057631 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0553f078-0f6e-4726-96d9-6d7518652354 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:05.071008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-79ce02ef-b13b-4041-a6a5-6bfc78a53880 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:05.072923 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-79ce02ef-b13b-4041-a6a5-6bfc78a53880 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:05.091750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79ce02ef-b13b-4041-a6a5-6bfc78a53880 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:05.091750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79ce02ef-b13b-4041-a6a5-6bfc78a53880 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:05.091750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79ce02ef-b13b-4041-a6a5-6bfc78a53880 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:05.094490 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79ce02ef-b13b-4041-a6a5-6bfc78a53880 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:05.095196 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79ce02ef-b13b-4041-a6a5-6bfc78a53880 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:05.096762 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79ce02ef-b13b-4041-a6a5-6bfc78a53880 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:05.267320 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-79ce02ef-b13b-4041-a6a5-6bfc78a53880 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:05.275335 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-79ce02ef-b13b-4041-a6a5-6bfc78a53880 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1429 microversion: 2.1 time: 0.214000 Aug 18 12:22:05.275953 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 104/211] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:05 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1429 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:05.281575 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-03c5379d-d2d2-43d0-a28a-407920d5438f req-dd5b449d-13ea-433d-a0b6-32c86f6a94b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c630629-baab-41d4-be06-ae0784a8b93e", "name": "network-vif-deleted", "tag": "adcb7fb2-bc8e-479f-8492-1e55ade7a8cc"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:05.294548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-03c5379d-d2d2-43d0-a28a-407920d5438f req-dd5b449d-13ea-433d-a0b6-32c86f6a94b2 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:05.302131 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-03c5379d-d2d2-43d0-a28a-407920d5438f req-dd5b449d-13ea-433d-a0b6-32c86f6a94b2 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:05.302131 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-03c5379d-d2d2-43d0-a28a-407920d5438f req-dd5b449d-13ea-433d-a0b6-32c86f6a94b2 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:05.305953 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0553f078-0f6e-4726-96d9-6d7518652354 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:05.308613 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-03c5379d-d2d2-43d0-a28a-407920d5438f req-dd5b449d-13ea-433d-a0b6-32c86f6a94b2 service nova] Creating event network-vif-deleted:adcb7fb2-bc8e-479f-8492-1e55ade7a8cc for instance 8c630629-baab-41d4-be06-ae0784a8b93e on hv-cinder-83602 Aug 18 12:22:05.314176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-03c5379d-d2d2-43d0-a28a-407920d5438f req-dd5b449d-13ea-433d-a0b6-32c86f6a94b2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036847 Aug 18 12:22:05.314921 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 105/212] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:22:05.317336 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0553f078-0f6e-4726-96d9-6d7518652354 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.281938 Aug 18 12:22:05.317907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 108/213] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:05 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:06.297648 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:06.299079 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:06.305871 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:06.306716 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:06.307366 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:06.308320 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:06.321327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:06.321327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:06.350787 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-cc07ee25-ad17-46a3-b4eb-cb3b33336227 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:06.350787 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-cc07ee25-ad17-46a3-b4eb-cb3b33336227 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:06.376227 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc07ee25-ad17-46a3-b4eb-cb3b33336227 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:06.385818 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc07ee25-ad17-46a3-b4eb-cb3b33336227 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:06.385818 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc07ee25-ad17-46a3-b4eb-cb3b33336227 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:06.385818 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc07ee25-ad17-46a3-b4eb-cb3b33336227 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:06.385818 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc07ee25-ad17-46a3-b4eb-cb3b33336227 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:06.387058 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc07ee25-ad17-46a3-b4eb-cb3b33336227 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:06.401719 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:06.403636 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:06.405442 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:06.407256 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lazy-loading 'fault' on Instance uuid 8c630629-baab-41d4-be06-ae0784a8b93e {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:22:06.606724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991cdaf69fd5439c9cad12cc2be49ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2edbbd46f54ad29ce12dad1762aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:06.628506 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ee653384-b15b-4601-9308-e2fada1e061c tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 200 len: 1305 microversion: 2.1 time: 0.335191 Aug 18 12:22:06.631958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 106/214] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:06 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 1305 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:06.681803 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-cc07ee25-ad17-46a3-b4eb-cb3b33336227 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:06.690422 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-cc07ee25-ad17-46a3-b4eb-cb3b33336227 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.355812 Aug 18 12:22:06.691361 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 109/215] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:06 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:07.654804 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:07.660254 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] [instance: 8c630629-baab-41d4-be06-ae0784a8b93e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:07.662546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:07.663299 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:07.663855 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:07.664549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:07.665067 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:07.665401 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:07.713817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0dab30b0-ddad-46f5-92de-f177a6c4b198 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:07.714572 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0dab30b0-ddad-46f5-92de-f177a6c4b198 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:07.721485 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dab30b0-ddad-46f5-92de-f177a6c4b198 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:07.721987 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dab30b0-ddad-46f5-92de-f177a6c4b198 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:07.722428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dab30b0-ddad-46f5-92de-f177a6c4b198 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:07.723403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dab30b0-ddad-46f5-92de-f177a6c4b198 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:07.724049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dab30b0-ddad-46f5-92de-f177a6c4b198 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:07.724645 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dab30b0-ddad-46f5-92de-f177a6c4b198 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:07.868391 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] HTTP exception thrown: Instance 8c630629-baab-41d4-be06-ae0784a8b93e could not be found. Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Request method failure captured: Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e HTTP/1.1 Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i7TxQZScNG6iwHF8Ka7aAO_GlhwCUOW6REPVYqqZNOr9edrvzNLV8nmtJ8x0xx1Ob5fXv6VDJrcfCF-bDNDL9mTrU3POgxx6MxB9g_mv1DRdMIicsGlt24R0zwWNdR1DzmGFw05L74xR2L4bKV9tftYhTJtgrYboST34jZEsEZEu-Y Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 9b2edbbd46f54ad29ce12dad1762aaa7 Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-VolumesNegativeTest-607801676 Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:22:07.870737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/9b2edbbd46f54ad29ce12dad1762aaa7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/9b2edbbd46f54ad29ce12dad1762aaa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/9b2edbbd46f54ad29ce12dad1762aaa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_9b2edbbd46f54ad29ce12dad1762aaa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-VolumesNegativeTest-607801676 Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 9b2edbbd46f54ad29ce12dad1762aaa7 Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-VolumesNegativeTest-607801676 Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-VolumesNegativeTest-607801676-project Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 991cdaf69fd5439c9cad12cc2be49ada Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-VolumesNegativeTest-607801676-project Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 8c630629-baab-41d4-be06-ae0784a8b93e could not be found. Aug 18 12:22:07.872294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '8c630629-baab-41d4-be06-ae0784a8b93e'} Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c630629-baab-41d4-be06-ae0784a8b93e could not be found. Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:22:07.873075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c630629-baab-41d4-be06-ae0784a8b93e could not be found. Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c630629-baab-41d4-be06-ae0784a8b93e could not be found. Aug 18 12:22:07.874224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:22:07.877726 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] Returning 404 to user: Instance 8c630629-baab-41d4-be06-ae0784a8b93e could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:22:07.878878 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c6ba0b77-1ffb-4bd4-91e6-79d013ecb5d7 tempest-VolumesNegativeTest-607801676 tempest-VolumesNegativeTest-607801676-project] 10.222.0.98 "GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e" status: 404 len: 111 microversion: 2.1 time: 0.228363 Aug 18 12:22:07.880100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 107/216] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:07 2022] GET /compute/v2.1/servers/8c630629-baab-41d4-be06-ae0784a8b93e => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:22:08.018955 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0dab30b0-ddad-46f5-92de-f177a6c4b198 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:08.027731 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0dab30b0-ddad-46f5-92de-f177a6c4b198 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.319814 Aug 18 12:22:08.029126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 110/217] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:07 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:09.060538 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-01c5a310-ae65-46a7-990c-d0423b51f367 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:09.064983 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-01c5a310-ae65-46a7-990c-d0423b51f367 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:09.075356 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-01c5a310-ae65-46a7-990c-d0423b51f367 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:09.086273 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-01c5a310-ae65-46a7-990c-d0423b51f367 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:09.088027 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-01c5a310-ae65-46a7-990c-d0423b51f367 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:09.090118 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-01c5a310-ae65-46a7-990c-d0423b51f367 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:09.094012 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-01c5a310-ae65-46a7-990c-d0423b51f367 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:09.094622 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-01c5a310-ae65-46a7-990c-d0423b51f367 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:09.315567 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-01c5a310-ae65-46a7-990c-d0423b51f367 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:09.324175 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-01c5a310-ae65-46a7-990c-d0423b51f367 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.277359 Aug 18 12:22:09.330250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 108/218] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:09 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:10.292641 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-1b2e235f-56d7-4025-8b04-1154a153bfba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:10.293860 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-1b2e235f-56d7-4025-8b04-1154a153bfba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:10.306363 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1b2e235f-56d7-4025-8b04-1154a153bfba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:10.307509 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1b2e235f-56d7-4025-8b04-1154a153bfba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:10.313704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1b2e235f-56d7-4025-8b04-1154a153bfba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:10.313704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1b2e235f-56d7-4025-8b04-1154a153bfba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:10.313704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1b2e235f-56d7-4025-8b04-1154a153bfba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:10.313704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1b2e235f-56d7-4025-8b04-1154a153bfba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:10.348183 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c3f88b2f-5756-44a7-94da-e2f0b84c3afe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:10.349596 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c3f88b2f-5756-44a7-94da-e2f0b84c3afe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:10.366042 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f88b2f-5756-44a7-94da-e2f0b84c3afe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:10.368826 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f88b2f-5756-44a7-94da-e2f0b84c3afe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:10.371971 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f88b2f-5756-44a7-94da-e2f0b84c3afe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:10.377220 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f88b2f-5756-44a7-94da-e2f0b84c3afe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:10.377220 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f88b2f-5756-44a7-94da-e2f0b84c3afe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:10.379536 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f88b2f-5756-44a7-94da-e2f0b84c3afe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:10.391451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-1b2e235f-56d7-4025-8b04-1154a153bfba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/ips" status: 200 len: 146 microversion: 2.1 time: 0.100615 Aug 18 12:22:10.413290 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 111/219] 10.222.0.98 () {58 vars in 1248 bytes} [Thu Aug 18 12:22:10 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/ips => generated 146 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:22:10.734814 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c3f88b2f-5756-44a7-94da-e2f0b84c3afe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:10.744515 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c3f88b2f-5756-44a7-94da-e2f0b84c3afe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.402879 Aug 18 12:22:10.745099 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 109/220] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:10 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:11.777989 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fc32f2ef-d33a-4ab7-bc8c-af139934cf2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:11.779297 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fc32f2ef-d33a-4ab7-bc8c-af139934cf2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:11.786217 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc32f2ef-d33a-4ab7-bc8c-af139934cf2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:11.787007 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc32f2ef-d33a-4ab7-bc8c-af139934cf2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:11.787489 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc32f2ef-d33a-4ab7-bc8c-af139934cf2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:11.788198 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc32f2ef-d33a-4ab7-bc8c-af139934cf2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:11.788657 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc32f2ef-d33a-4ab7-bc8c-af139934cf2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:11.789085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc32f2ef-d33a-4ab7-bc8c-af139934cf2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:12.014511 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fc32f2ef-d33a-4ab7-bc8c-af139934cf2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:12.034502 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fc32f2ef-d33a-4ab7-bc8c-af139934cf2b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.269553 Aug 18 12:22:12.036410 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5d229e4d-0405-454f-82c2-7d2ea5059d7c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Action: 'create', calling method: .version_select at 0x7f3794a08160>, body: {"keypair": {"name": "tempest-keypair-747974205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQPODA/HaiC00eC8G9p/1JfQy39FXGHwrCJzf9IRywo2hLMEEhsg4BCn967AwiZGelnGRdP5Gvi+JmURaeCvqkPMXJcuybli7os8lf+ZoJ8CaiVczVFE8vwKeJS6uRshw=="}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:12.055846 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 110/221] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:11 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:12.087938 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-5d229e4d-0405-454f-82c2-7d2ea5059d7c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Getting quotas for project 80ccf2ca9a634becb2eee93fddbd2258. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:22:12.092584 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-5d229e4d-0405-454f-82c2-7d2ea5059d7c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Getting quotas for user d98949bd624a4330a473ebe5de31586a and project 80ccf2ca9a634becb2eee93fddbd2258. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:22:12.318094 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5d229e4d-0405-454f-82c2-7d2ea5059d7c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.574539 Aug 18 12:22:12.323302 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 112/222] 10.222.0.98 () {62 vars in 1200 bytes} [Thu Aug 18 12:22:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 576 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 12:22:13.066035 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1efb9286-d72b-4f66-802b-c267e8098b71 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:13.067285 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1efb9286-d72b-4f66-802b-c267e8098b71 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:13.085790 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1efb9286-d72b-4f66-802b-c267e8098b71 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:13.088062 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1efb9286-d72b-4f66-802b-c267e8098b71 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:13.090339 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1efb9286-d72b-4f66-802b-c267e8098b71 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:13.091329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1efb9286-d72b-4f66-802b-c267e8098b71 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:13.093536 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1efb9286-d72b-4f66-802b-c267e8098b71 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:13.095352 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1efb9286-d72b-4f66-802b-c267e8098b71 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:13.405958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1efb9286-d72b-4f66-802b-c267e8098b71 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:13.413743 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1efb9286-d72b-4f66-802b-c267e8098b71 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.357046 Aug 18 12:22:13.414232 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 111/223] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:13 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:14.224497 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2ed37249-d91d-48c5-bb76-65a5c8fadbb8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8fa5481-6dbe-459a-b2ae-999553900193"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:14.227503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2ed37249-d91d-48c5-bb76-65a5c8fadbb8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:14.234824 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ed37249-d91d-48c5-bb76-65a5c8fadbb8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:14.235369 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ed37249-d91d-48c5-bb76-65a5c8fadbb8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:14.236043 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ed37249-d91d-48c5-bb76-65a5c8fadbb8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:14.236754 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ed37249-d91d-48c5-bb76-65a5c8fadbb8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:14.237221 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ed37249-d91d-48c5-bb76-65a5c8fadbb8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:14.237644 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ed37249-d91d-48c5-bb76-65a5c8fadbb8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:14.448637 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b106391d-fe1f-4f23-b0d0-4bf000a77b21 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:14.449245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b106391d-fe1f-4f23-b0d0-4bf000a77b21 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:14.466880 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b106391d-fe1f-4f23-b0d0-4bf000a77b21 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:14.467366 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b106391d-fe1f-4f23-b0d0-4bf000a77b21 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:14.468557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b106391d-fe1f-4f23-b0d0-4bf000a77b21 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:14.469475 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b106391d-fe1f-4f23-b0d0-4bf000a77b21 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:14.469915 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b106391d-fe1f-4f23-b0d0-4bf000a77b21 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:14.470329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b106391d-fe1f-4f23-b0d0-4bf000a77b21 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:14.753625 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b106391d-fe1f-4f23-b0d0-4bf000a77b21 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:14.767669 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b106391d-fe1f-4f23-b0d0-4bf000a77b21 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.329918 Aug 18 12:22:14.768770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 112/224] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:14 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:15.224777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2ed37249-d91d-48c5-bb76-65a5c8fadbb8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "POST /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.004436 Aug 18 12:22:15.229136 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 113/225] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:22:14 2022] POST /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/os-volume_attachments => generated 194 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:22:15.791757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8a3968e7-61e7-4aba-acb3-5e54905c0301 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:15.791757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8a3968e7-61e7-4aba-acb3-5e54905c0301 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:15.810973 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a3968e7-61e7-4aba-acb3-5e54905c0301 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:15.811587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a3968e7-61e7-4aba-acb3-5e54905c0301 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:15.812561 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a3968e7-61e7-4aba-acb3-5e54905c0301 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:15.815478 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a3968e7-61e7-4aba-acb3-5e54905c0301 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:15.816069 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a3968e7-61e7-4aba-acb3-5e54905c0301 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:15.816772 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a3968e7-61e7-4aba-acb3-5e54905c0301 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:16.068373 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8a3968e7-61e7-4aba-acb3-5e54905c0301 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:16.076921 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8a3968e7-61e7-4aba-acb3-5e54905c0301 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.291585 Aug 18 12:22:16.087503 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 113/226] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:15 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:16.254367 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-114584088", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "538c1b4e-3178-42cd-9f3d-46d6a15a2ee9"}], "security_groups": [{"name": "tempest-securitygroup--401110286"}], "key_name": "tempest-keypair-747974205", "user_data": "}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:16.448563 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] validate_networks() for [('538c1b4e-3178-42cd-9f3d-46d6a15a2ee9', None, None, None, None, None)] {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:22:16.876666 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:22:16.877166 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:22:16.877723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:22:16.878045 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:22:16.878451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:22:16.887633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:16.888340 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:16.888781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:16.889679 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:16.890042 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:16.890800 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:16.913790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Getting quotas for project 80ccf2ca9a634becb2eee93fddbd2258. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:22:16.918265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Getting quotas for user d98949bd624a4330a473ebe5de31586a and project 80ccf2ca9a634becb2eee93fddbd2258. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:22:16.930733 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:22:16.933150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:22:17.076663 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-11d828a0-76a4-4203-bf8a-cd62e0e80b9c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.827828 Aug 18 12:22:17.077333 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 114/227] 10.222.0.98 () {62 vars in 1188 bytes} [Thu Aug 18 12:22:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 12:22:17.088090 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0b9c16fa-fdb3-4dd3-a483-0507f6313af0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:17.089329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0b9c16fa-fdb3-4dd3-a483-0507f6313af0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:17.104100 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4386d82c-cea3-4925-af2c-a5fb6afb5695 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:17.104882 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4386d82c-cea3-4925-af2c-a5fb6afb5695 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:17.112894 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4386d82c-cea3-4925-af2c-a5fb6afb5695 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:17.113381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4386d82c-cea3-4925-af2c-a5fb6afb5695 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:17.113937 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4386d82c-cea3-4925-af2c-a5fb6afb5695 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:17.114522 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4386d82c-cea3-4925-af2c-a5fb6afb5695 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:17.114975 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4386d82c-cea3-4925-af2c-a5fb6afb5695 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:17.115398 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4386d82c-cea3-4925-af2c-a5fb6afb5695 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:17.157524 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0b9c16fa-fdb3-4dd3-a483-0507f6313af0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:17.169137 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0b9c16fa-fdb3-4dd3-a483-0507f6313af0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:17.171574 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0b9c16fa-fdb3-4dd3-a483-0507f6313af0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:17.173098 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0b9c16fa-fdb3-4dd3-a483-0507f6313af0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1280 microversion: 2.20 time: 0.088780 Aug 18 12:22:17.174205 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 114/228] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:17 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:22:17.298055 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4386d82c-cea3-4925-af2c-a5fb6afb5695 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:17.307758 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4386d82c-cea3-4925-af2c-a5fb6afb5695 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.208232 Aug 18 12:22:17.308397 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 115/229] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:17 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:18.196578 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-586a2150-d10f-4f60-a5f0-82bb46c92b95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:18.197189 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-586a2150-d10f-4f60-a5f0-82bb46c92b95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:18.255735 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-586a2150-d10f-4f60-a5f0-82bb46c92b95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:18.265215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-586a2150-d10f-4f60-a5f0-82bb46c92b95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:18.266822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-586a2150-d10f-4f60-a5f0-82bb46c92b95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:18.268014 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-586a2150-d10f-4f60-a5f0-82bb46c92b95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1280 microversion: 2.20 time: 0.075445 Aug 18 12:22:18.268995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 115/230] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:18 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:18.329461 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-cff6c127-9ec6-4d0a-b282-37f1ebe78868 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:18.330073 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-cff6c127-9ec6-4d0a-b282-37f1ebe78868 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:18.345536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cff6c127-9ec6-4d0a-b282-37f1ebe78868 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:18.347983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cff6c127-9ec6-4d0a-b282-37f1ebe78868 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:18.347983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cff6c127-9ec6-4d0a-b282-37f1ebe78868 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:18.347983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cff6c127-9ec6-4d0a-b282-37f1ebe78868 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:18.347983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cff6c127-9ec6-4d0a-b282-37f1ebe78868 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:18.348341 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cff6c127-9ec6-4d0a-b282-37f1ebe78868 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:18.660265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-cff6c127-9ec6-4d0a-b282-37f1ebe78868 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:18.674778 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-cff6c127-9ec6-4d0a-b282-37f1ebe78868 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.348818 Aug 18 12:22:18.678821 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 116/231] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:18 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:19.294224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:19.294847 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:19.304315 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:19.304798 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:19.305232 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:19.305922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:19.306373 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:19.306793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:19.391359 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:19.401319 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:19.402946 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:19.406299 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c34bb8c8-a3d2-403d-a549-5ee57718882d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1284 microversion: 2.20 time: 0.113888 Aug 18 12:22:19.407163 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 116/232] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:19 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:19.703678 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-545c2162-b500-4c08-931c-ec0e1443da70 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:19.704277 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-545c2162-b500-4c08-931c-ec0e1443da70 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:19.710374 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-545c2162-b500-4c08-931c-ec0e1443da70 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:19.710851 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-545c2162-b500-4c08-931c-ec0e1443da70 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:19.711392 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-545c2162-b500-4c08-931c-ec0e1443da70 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:19.712126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-545c2162-b500-4c08-931c-ec0e1443da70 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:19.712500 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-545c2162-b500-4c08-931c-ec0e1443da70 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:19.712916 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-545c2162-b500-4c08-931c-ec0e1443da70 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:19.878946 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-545c2162-b500-4c08-931c-ec0e1443da70 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:19.895382 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-545c2162-b500-4c08-931c-ec0e1443da70 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.196388 Aug 18 12:22:19.899555 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 117/233] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:19 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:20.428088 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:20.428719 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:20.438744 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:20.439634 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:20.440262 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:20.441293 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:20.441932 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:20.442626 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:20.511004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:20.518958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:20.520669 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:20.521771 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-677511e8-b85f-4771-8602-c6a819819d5b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1332 microversion: 2.20 time: 0.097819 Aug 18 12:22:20.522322 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 117/234] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:20 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:20.925038 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e682edcb-d0e2-4b2a-97d3-c68189343bd8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:20.925677 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e682edcb-d0e2-4b2a-97d3-c68189343bd8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:20.932307 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e682edcb-d0e2-4b2a-97d3-c68189343bd8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:20.932984 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e682edcb-d0e2-4b2a-97d3-c68189343bd8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:20.933591 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e682edcb-d0e2-4b2a-97d3-c68189343bd8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:20.934481 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e682edcb-d0e2-4b2a-97d3-c68189343bd8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:20.935222 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e682edcb-d0e2-4b2a-97d3-c68189343bd8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:20.935685 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e682edcb-d0e2-4b2a-97d3-c68189343bd8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:21.081745 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e682edcb-d0e2-4b2a-97d3-c68189343bd8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:21.089807 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e682edcb-d0e2-4b2a-97d3-c68189343bd8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.168962 Aug 18 12:22:21.090389 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 118/235] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:20 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:21.546548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:21.547079 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:21.553262 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:21.553743 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:21.554174 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:21.554858 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:21.555306 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:21.555762 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:21.559872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:21.617694 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:21.626436 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:21.628176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:21.629271 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-eb05a659-e503-4829-ad81-9baaa529df68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1332 microversion: 2.20 time: 0.087018 Aug 18 12:22:21.629848 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 118/236] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:21 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:22.112543 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5dbe7408-6782-4661-94a8-8a781358a773 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:22.113339 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5dbe7408-6782-4661-94a8-8a781358a773 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:22.120758 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dbe7408-6782-4661-94a8-8a781358a773 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:22.121248 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dbe7408-6782-4661-94a8-8a781358a773 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:22.121690 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dbe7408-6782-4661-94a8-8a781358a773 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:22.122432 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dbe7408-6782-4661-94a8-8a781358a773 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:22.122891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dbe7408-6782-4661-94a8-8a781358a773 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:22.123315 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dbe7408-6782-4661-94a8-8a781358a773 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:22.261774 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5dbe7408-6782-4661-94a8-8a781358a773 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:22.270372 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5dbe7408-6782-4661-94a8-8a781358a773 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.161973 Aug 18 12:22:22.270951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 119/237] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:22 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:22.652785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:22.653344 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:22.659797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:22.660282 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:22.663109 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:22.663109 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:22.663109 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:22.663109 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:22.723156 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:22.731049 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:22.732607 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:22.734345 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5cac54e0-1036-4aed-ab62-8b1b4bea5386 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1332 microversion: 2.20 time: 0.086006 Aug 18 12:22:22.734928 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 119/238] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:22 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:23.275390 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-984319316", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "networks": [{"uuid": "5e073d15-f9de-4f1c-bdfd-768829fe9e53"}]}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:23.298700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-db24e430-d42c-439f-a31d-32bb1af230ab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:23.299315 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-db24e430-d42c-439f-a31d-32bb1af230ab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:23.306670 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db24e430-d42c-439f-a31d-32bb1af230ab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:23.307201 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db24e430-d42c-439f-a31d-32bb1af230ab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:23.307784 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db24e430-d42c-439f-a31d-32bb1af230ab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:23.308716 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db24e430-d42c-439f-a31d-32bb1af230ab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:23.309173 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db24e430-d42c-439f-a31d-32bb1af230ab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:23.309600 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db24e430-d42c-439f-a31d-32bb1af230ab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:23.333057 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] validate_networks() for [('5e073d15-f9de-4f1c-bdfd-768829fe9e53', None, None, None, None, None)] {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:22:23.461877 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-db24e430-d42c-439f-a31d-32bb1af230ab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:23.475554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-db24e430-d42c-439f-a31d-32bb1af230ab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.181272 Aug 18 12:22:23.477950 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 120/239] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:23 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:23.762165 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:23.762165 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:23.762809 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:22:23.762809 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:22:23.763382 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:22:23.763935 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:22:23.765158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:22:23.770898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:23.771396 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:23.771854 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:23.772721 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:23.773453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:23.774368 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:23.783562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:23.783562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:23.783774 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:23.784421 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:23.784871 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:23.785329 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:23.792658 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:23.803471 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Getting quotas for project c01ab18435804769bb4ae0bf86d4d99d. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:22:23.807431 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Getting quotas for user e6b767c363bb4a6fa3530f6a677e09f2 and project c01ab18435804769bb4ae0bf86d4d99d. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:22:23.821755 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:22:23.824111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:22:23.854663 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:23.862669 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:23.864440 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:23.865675 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-094d2de8-cf39-450f-9c37-f21a6c6a6c68 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1340 microversion: 2.20 time: 0.111187 Aug 18 12:22:23.866308 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 121/240] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:23 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1340 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:22:24.029214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-eb7bf69c-1f62-4a40-b06a-032d4da87b1a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757573 Aug 18 12:22:24.030938 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 120/241] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:22:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:22:24.042555 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a0a1ce82-fbd3-4a13-8cdf-3432f234e325 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:24.043474 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a0a1ce82-fbd3-4a13-8cdf-3432f234e325 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:24.112481 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a0a1ce82-fbd3-4a13-8cdf-3432f234e325 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:24.120189 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a0a1ce82-fbd3-4a13-8cdf-3432f234e325 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1218 microversion: 2.1 time: 0.081699 Aug 18 12:22:24.120752 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 122/242] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:24 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:24.498184 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e4ecd5e7-462b-471e-b01d-7330875cebe7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:24.499436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e4ecd5e7-462b-471e-b01d-7330875cebe7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:24.507300 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5e7-462b-471e-b01d-7330875cebe7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:24.510673 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5e7-462b-471e-b01d-7330875cebe7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:24.511158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5e7-462b-471e-b01d-7330875cebe7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:24.511973 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5e7-462b-471e-b01d-7330875cebe7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:24.512494 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5e7-462b-471e-b01d-7330875cebe7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:24.512917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5e7-462b-471e-b01d-7330875cebe7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:24.663041 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e4ecd5e7-462b-471e-b01d-7330875cebe7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:24.674614 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e4ecd5e7-462b-471e-b01d-7330875cebe7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1503 microversion: 2.1 time: 0.178935 Aug 18 12:22:24.674614 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 121/243] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:24 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:24.695062 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bcc1191-b961-4fab-9cbd-41d5d7f4b380"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:24.698486 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:24.707113 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:24.707756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:24.708198 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:24.715427 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:24.715427 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:24.715427 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:24.736052 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] HTTP exception thrown: Cannot 'attach_volume' instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 while it is in vm_state rescued Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Request method failure captured: Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: POST /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2/os-volume_attachments HTTP/1.1 Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 74 Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i6Pc1iShlC4ACTcOWwbv896mVUJ_VCuPhjuPkGFza81A1LvrVOukwsF5_eB3xdrTQK1i8i79gID74Vli7zDHlRdCqloU9q3_SZ2580Is2rSbBhnRdmwSF3kQoOWg2EYGof8CdvJE5X_A8zanheUiphbBAGE7-CpkQl3RNeVfWW7cqs Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 965cf5f488364e0ea8b52cdc78de2641 Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:22:24.737686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 965cf5f488364e0ea8b52cdc78de2641 Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-ServerRescueNegativeTestJSON-934320463-project Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 2e8380a466484c83bca842518d171048 Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-ServerRescueNegativeTestJSON-934320463-project Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {"volumeAttachment": {"volumeId": "5bcc1191-b961-4fab-9cbd-41d5d7f4b380"}} Aug 18 12:22:24.739192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Cannot 'attach_volume' instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 while it is in vm_state rescued Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'server_id': '8e4aedfb-2e3b-400c-9c97-9a0939976eb2', 'body': {'volumeAttachment': {'volumeId': '5bcc1191-b961-4fab-9cbd-41d5d7f4b380'}}} Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:22:24.740500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 while it is in vm_state rescued Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:22:24.741810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:22:24.750968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:22:24.750968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:22:24.750968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 while it is in vm_state rescued Aug 18 12:22:24.750968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:22:24.750968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Returning 409 to user: Cannot 'attach_volume' instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 while it is in vm_state rescued {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:22:24.750968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1ea946f3-d0c9-4031-ab8d-3d817a478403 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "POST /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048989 Aug 18 12:22:24.750968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 123/244] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:22:24 2022] POST /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 18 12:22:24.751644 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-eb3e0c9c-8c12-4604-bf46-ad11ac5f2a56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:24.751644 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-eb3e0c9c-8c12-4604-bf46-ad11ac5f2a56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:24.757654 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb3e0c9c-8c12-4604-bf46-ad11ac5f2a56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:24.758147 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb3e0c9c-8c12-4604-bf46-ad11ac5f2a56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:24.758587 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb3e0c9c-8c12-4604-bf46-ad11ac5f2a56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:24.759464 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb3e0c9c-8c12-4604-bf46-ad11ac5f2a56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:24.759908 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb3e0c9c-8c12-4604-bf46-ad11ac5f2a56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:24.760331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eb3e0c9c-8c12-4604-bf46-ad11ac5f2a56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:24.890738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:24.891617 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:24.898571 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:24.900184 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:24.901964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:24.901964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:24.902316 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:24.902932 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:24.986030 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:24.996598 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:24.998082 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:24.999909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0db07b5d-dd4b-434a-a5db-65b757a931f0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1338 microversion: 2.20 time: 0.114260 Aug 18 12:22:25.000493 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 124/245] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:24 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:25.023310 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-eb3e0c9c-8c12-4604-bf46-ad11ac5f2a56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "POST /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2/action" status: 202 len: 0 microversion: 2.1 time: 0.277258 Aug 18 12:22:25.023993 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 122/246] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:22:24 2022] POST /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:22:25.037441 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-18f7a900-5ba1-463d-ad9e-f2a007883bd2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:25.038213 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-18f7a900-5ba1-463d-ad9e-f2a007883bd2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:25.044360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-18f7a900-5ba1-463d-ad9e-f2a007883bd2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:25.044839 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-18f7a900-5ba1-463d-ad9e-f2a007883bd2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:25.045414 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-18f7a900-5ba1-463d-ad9e-f2a007883bd2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:25.046556 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-18f7a900-5ba1-463d-ad9e-f2a007883bd2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:25.047012 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-18f7a900-5ba1-463d-ad9e-f2a007883bd2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:25.047472 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-18f7a900-5ba1-463d-ad9e-f2a007883bd2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:25.141898 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a90366b0-5039-498f-9327-c301e191a664 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:25.142597 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a90366b0-5039-498f-9327-c301e191a664 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:25.196160 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a90366b0-5039-498f-9327-c301e191a664 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:25.204887 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a90366b0-5039-498f-9327-c301e191a664 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1218 microversion: 2.1 time: 0.067860 Aug 18 12:22:25.205610 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 123/247] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:25 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:25.231739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-18f7a900-5ba1-463d-ad9e-f2a007883bd2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:25.239347 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-18f7a900-5ba1-463d-ad9e-f2a007883bd2 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1511 microversion: 2.1 time: 0.205777 Aug 18 12:22:25.239960 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 125/248] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:25 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:25.512612 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3a98a87f-367c-4f22-b67f-58b499cf04c1 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:25.520236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3a98a87f-367c-4f22-b67f-58b499cf04c1 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:25.521002 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3a98a87f-367c-4f22-b67f-58b499cf04c1 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:25.521650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3a98a87f-367c-4f22-b67f-58b499cf04c1 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:25.588306 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3a98a87f-367c-4f22-b67f-58b499cf04c1 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Going to try to stop instance {{(pid=121244) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 12:22:25.821537 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3a98a87f-367c-4f22-b67f-58b499cf04c1 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "POST /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/action" status: 202 len: 0 microversion: 2.1 time: 0.312744 Aug 18 12:22:25.822137 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 124/249] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:22:25 2022] POST /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:22:25.830274 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-152015f0-82ea-4b63-86e1-86e7150ab56b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:25.830881 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-152015f0-82ea-4b63-86e1-86e7150ab56b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:25.836806 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-152015f0-82ea-4b63-86e1-86e7150ab56b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:25.837275 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-152015f0-82ea-4b63-86e1-86e7150ab56b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:25.837707 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-152015f0-82ea-4b63-86e1-86e7150ab56b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:25.838377 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-152015f0-82ea-4b63-86e1-86e7150ab56b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:25.838815 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-152015f0-82ea-4b63-86e1-86e7150ab56b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:25.839335 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-152015f0-82ea-4b63-86e1-86e7150ab56b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:25.976401 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-152015f0-82ea-4b63-86e1-86e7150ab56b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:25.984929 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-152015f0-82ea-4b63-86e1-86e7150ab56b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.158556 Aug 18 12:22:25.985514 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 126/250] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:25 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:26.023309 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:26.024045 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:26.030856 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:26.033031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:26.033031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:26.033031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:26.033031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:26.033381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:26.168384 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:26.176572 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:26.178356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:26.179553 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e94d286b-b44b-49e1-bcf7-db3c3e62481f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.160550 Aug 18 12:22:26.180056 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 125/251] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:26 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:26.225473 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d960ff25-8f44-484e-82c8-ca06efa7aca8 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:26.226074 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d960ff25-8f44-484e-82c8-ca06efa7aca8 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:26.232093 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d960ff25-8f44-484e-82c8-ca06efa7aca8 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:26.232569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d960ff25-8f44-484e-82c8-ca06efa7aca8 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:26.233005 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d960ff25-8f44-484e-82c8-ca06efa7aca8 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:26.233685 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d960ff25-8f44-484e-82c8-ca06efa7aca8 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:26.234131 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d960ff25-8f44-484e-82c8-ca06efa7aca8 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:26.234549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d960ff25-8f44-484e-82c8-ca06efa7aca8 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:26.260926 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ee2d16c8-61ae-4797-b7f5-f3e6a897cb7c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:26.261672 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ee2d16c8-61ae-4797-b7f5-f3e6a897cb7c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:26.268279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ee2d16c8-61ae-4797-b7f5-f3e6a897cb7c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:26.268767 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ee2d16c8-61ae-4797-b7f5-f3e6a897cb7c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:26.269206 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ee2d16c8-61ae-4797-b7f5-f3e6a897cb7c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:26.269933 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ee2d16c8-61ae-4797-b7f5-f3e6a897cb7c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:26.270410 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ee2d16c8-61ae-4797-b7f5-f3e6a897cb7c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:26.270882 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ee2d16c8-61ae-4797-b7f5-f3e6a897cb7c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:26.295974 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d960ff25-8f44-484e-82c8-ca06efa7aca8 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:26.303599 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d960ff25-8f44-484e-82c8-ca06efa7aca8 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1222 microversion: 2.1 time: 0.082018 Aug 18 12:22:26.304165 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 127/252] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:26 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:26.409841 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ee2d16c8-61ae-4797-b7f5-f3e6a897cb7c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:26.417721 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ee2d16c8-61ae-4797-b7f5-f3e6a897cb7c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1511 microversion: 2.1 time: 0.160559 Aug 18 12:22:26.418313 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 126/253] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:26 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:27.005917 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-9aa9dc4e-58f5-4c64-8e85-f27b06760b1d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:27.006529 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-9aa9dc4e-58f5-4c64-8e85-f27b06760b1d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:27.012536 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9aa9dc4e-58f5-4c64-8e85-f27b06760b1d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:27.013016 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9aa9dc4e-58f5-4c64-8e85-f27b06760b1d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:27.013450 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9aa9dc4e-58f5-4c64-8e85-f27b06760b1d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:27.014140 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9aa9dc4e-58f5-4c64-8e85-f27b06760b1d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:27.014593 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9aa9dc4e-58f5-4c64-8e85-f27b06760b1d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:27.015049 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9aa9dc4e-58f5-4c64-8e85-f27b06760b1d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:27.144643 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-9aa9dc4e-58f5-4c64-8e85-f27b06760b1d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:27.152834 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-9aa9dc4e-58f5-4c64-8e85-f27b06760b1d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.150717 Aug 18 12:22:27.153405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 128/254] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:27 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:27.202118 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:27.202724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:27.209361 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:27.209850 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:27.210286 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:27.211005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:27.211480 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:27.211911 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:27.324522 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-79725d60-1fab-4f9e-884f-38c31bbf7d66 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:27.325240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-79725d60-1fab-4f9e-884f-38c31bbf7d66 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:27.331334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79725d60-1fab-4f9e-884f-38c31bbf7d66 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:27.331881 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79725d60-1fab-4f9e-884f-38c31bbf7d66 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:27.332385 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79725d60-1fab-4f9e-884f-38c31bbf7d66 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:27.333343 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79725d60-1fab-4f9e-884f-38c31bbf7d66 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:27.333625 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79725d60-1fab-4f9e-884f-38c31bbf7d66 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:27.334052 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-79725d60-1fab-4f9e-884f-38c31bbf7d66 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:27.344544 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:27.352521 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:27.354048 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:27.355159 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-92c8ca6e-8755-48ae-a162-f9259f3868e5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.156992 Aug 18 12:22:27.355756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 127/255] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:27 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:27.395598 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-79725d60-1fab-4f9e-884f-38c31bbf7d66 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:27.403304 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-79725d60-1fab-4f9e-884f-38c31bbf7d66 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1222 microversion: 2.1 time: 0.083178 Aug 18 12:22:27.403908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 129/256] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:27 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:27.438925 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-9809d5da-31c4-4100-90d9-e1473821b63c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:27.439571 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-9809d5da-31c4-4100-90d9-e1473821b63c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:27.445597 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9809d5da-31c4-4100-90d9-e1473821b63c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:27.446084 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9809d5da-31c4-4100-90d9-e1473821b63c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:27.446520 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9809d5da-31c4-4100-90d9-e1473821b63c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:27.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9809d5da-31c4-4100-90d9-e1473821b63c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:27.447690 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9809d5da-31c4-4100-90d9-e1473821b63c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:27.448121 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9809d5da-31c4-4100-90d9-e1473821b63c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:27.578763 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-9809d5da-31c4-4100-90d9-e1473821b63c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:27.586305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-9809d5da-31c4-4100-90d9-e1473821b63c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1511 microversion: 2.1 time: 0.151592 Aug 18 12:22:27.586868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 128/257] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:27 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:28.174881 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b83d8ce0-740a-4529-9c1c-cdea46290121 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:28.175595 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b83d8ce0-740a-4529-9c1c-cdea46290121 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:28.182896 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b83d8ce0-740a-4529-9c1c-cdea46290121 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:28.183489 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b83d8ce0-740a-4529-9c1c-cdea46290121 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:28.183988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b83d8ce0-740a-4529-9c1c-cdea46290121 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:28.189037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b83d8ce0-740a-4529-9c1c-cdea46290121 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:28.189037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b83d8ce0-740a-4529-9c1c-cdea46290121 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:28.189037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b83d8ce0-740a-4529-9c1c-cdea46290121 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:28.386295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:28.387684 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:28.397133 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:28.405358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:28.405358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:28.405358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:28.405358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:28.406318 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:28.486967 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b83d8ce0-740a-4529-9c1c-cdea46290121 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:28.495790 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b83d8ce0-740a-4529-9c1c-cdea46290121 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.325367 Aug 18 12:22:28.497487 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 130/258] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:28 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:28.502757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-44afd08d-a769-4be1-b22d-ebddc3fdd58a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:28.504271 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-44afd08d-a769-4be1-b22d-ebddc3fdd58a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:28.510903 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44afd08d-a769-4be1-b22d-ebddc3fdd58a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:28.511724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44afd08d-a769-4be1-b22d-ebddc3fdd58a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:28.512412 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44afd08d-a769-4be1-b22d-ebddc3fdd58a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:28.513334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44afd08d-a769-4be1-b22d-ebddc3fdd58a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:28.514716 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44afd08d-a769-4be1-b22d-ebddc3fdd58a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:28.515341 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44afd08d-a769-4be1-b22d-ebddc3fdd58a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:28.605911 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-44afd08d-a769-4be1-b22d-ebddc3fdd58a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:28.618171 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-44afd08d-a769-4be1-b22d-ebddc3fdd58a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1270 microversion: 2.1 time: 0.120240 Aug 18 12:22:28.622930 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 131/259] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:28 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:28.630436 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bf21c5bb-98d7-4204-a3e4-25aa95bb30ca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:28.631062 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bf21c5bb-98d7-4204-a3e4-25aa95bb30ca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:28.638862 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bf21c5bb-98d7-4204-a3e4-25aa95bb30ca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:28.639925 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bf21c5bb-98d7-4204-a3e4-25aa95bb30ca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:28.640392 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bf21c5bb-98d7-4204-a3e4-25aa95bb30ca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:28.641169 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bf21c5bb-98d7-4204-a3e4-25aa95bb30ca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:28.641746 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bf21c5bb-98d7-4204-a3e4-25aa95bb30ca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:28.642180 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bf21c5bb-98d7-4204-a3e4-25aa95bb30ca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:28.729983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:28.747299 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:28.750173 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:28.752000 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3fd50d1a-fba3-4b61-94c7-c5835e4d2ff0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.372605 Aug 18 12:22:28.752729 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 129/260] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:28 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:28.776128 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-f12d0866-6e94-4fd3-be78-d515afdc14c6 req-dd833049-cdf7-4769-89ca-755e3a0306b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4dfc92-fb5b-46f3-a14a-992de65d7adb", "tag": "45eda560-60cf-411c-954a-1838984f4e8f"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:28.797622 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-f12d0866-6e94-4fd3-be78-d515afdc14c6 req-dd833049-cdf7-4769-89ca-755e3a0306b0 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:28.798406 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-f12d0866-6e94-4fd3-be78-d515afdc14c6 req-dd833049-cdf7-4769-89ca-755e3a0306b0 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:28.799001 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-f12d0866-6e94-4fd3-be78-d515afdc14c6 req-dd833049-cdf7-4769-89ca-755e3a0306b0 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:28.810835 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-f12d0866-6e94-4fd3-be78-d515afdc14c6 req-dd833049-cdf7-4769-89ca-755e3a0306b0 service nova] Creating event network-changed:45eda560-60cf-411c-954a-1838984f4e8f for instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb on hv-cinder-83602 Aug 18 12:22:28.816928 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-f12d0866-6e94-4fd3-be78-d515afdc14c6 req-dd833049-cdf7-4769-89ca-755e3a0306b0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044370 Aug 18 12:22:28.818142 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 130/261] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:22:28.893903 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bf21c5bb-98d7-4204-a3e4-25aa95bb30ca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:28.913549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-bf21c5bb-98d7-4204-a3e4-25aa95bb30ca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1511 microversion: 2.1 time: 0.288638 Aug 18 12:22:28.914556 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 132/262] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:28 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:29.518354 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-bc5850bd-f11f-4ea4-a4a6-a3b94a607f52 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:29.518973 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-bc5850bd-f11f-4ea4-a4a6-a3b94a607f52 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:29.525226 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc5850bd-f11f-4ea4-a4a6-a3b94a607f52 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:29.525708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc5850bd-f11f-4ea4-a4a6-a3b94a607f52 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:29.526145 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc5850bd-f11f-4ea4-a4a6-a3b94a607f52 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:29.526838 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc5850bd-f11f-4ea4-a4a6-a3b94a607f52 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:29.527292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc5850bd-f11f-4ea4-a4a6-a3b94a607f52 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:29.527749 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc5850bd-f11f-4ea4-a4a6-a3b94a607f52 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:29.655272 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4ad9c12b-793e-4443-879d-6c9429876f07 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:29.656017 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-4ad9c12b-793e-4443-879d-6c9429876f07 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:29.662393 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ad9c12b-793e-4443-879d-6c9429876f07 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:29.665710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ad9c12b-793e-4443-879d-6c9429876f07 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:29.665710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ad9c12b-793e-4443-879d-6c9429876f07 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:29.665710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ad9c12b-793e-4443-879d-6c9429876f07 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:29.665710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ad9c12b-793e-4443-879d-6c9429876f07 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:29.666036 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ad9c12b-793e-4443-879d-6c9429876f07 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:29.731327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-4ad9c12b-793e-4443-879d-6c9429876f07 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:29.740373 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4ad9c12b-793e-4443-879d-6c9429876f07 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1278 microversion: 2.1 time: 0.089937 Aug 18 12:22:29.740968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 133/263] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:29 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:29.778874 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:29.779997 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:29.786747 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:29.787268 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:29.787735 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:29.788470 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:29.788920 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:29.789341 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:29.906374 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bc5850bd-f11f-4ea4-a4a6-a3b94a607f52 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:29.914556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-bc5850bd-f11f-4ea4-a4a6-a3b94a607f52 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.401273 Aug 18 12:22:29.915220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 131/264] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:29 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:29.938162 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d0a4b5b3-0e20-4e4c-a5e5-a7b260d83d8c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:29.939484 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:29.939608 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d0a4b5b3-0e20-4e4c-a5e5-a7b260d83d8c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:29.944801 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0a4b5b3-0e20-4e4c-a5e5-a7b260d83d8c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:29.945281 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0a4b5b3-0e20-4e4c-a5e5-a7b260d83d8c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:29.945722 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0a4b5b3-0e20-4e4c-a5e5-a7b260d83d8c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:29.946405 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0a4b5b3-0e20-4e4c-a5e5-a7b260d83d8c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:29.946787 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:29.946910 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0a4b5b3-0e20-4e4c-a5e5-a7b260d83d8c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:29.947244 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0a4b5b3-0e20-4e4c-a5e5-a7b260d83d8c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:29.948380 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:29.949493 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-253f3a38-d784-426d-ae3a-ea08de8e4ed1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.174644 Aug 18 12:22:29.950051 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 134/265] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:29 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:22:30.082388 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d0a4b5b3-0e20-4e4c-a5e5-a7b260d83d8c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:30.090424 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d0a4b5b3-0e20-4e4c-a5e5-a7b260d83d8c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1511 microversion: 2.1 time: 0.156015 Aug 18 12:22:30.091000 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 132/266] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:29 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:30.762647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e7fa716a-448c-45b3-9c17-b6695f936bf6 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:30.762647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e7fa716a-448c-45b3-9c17-b6695f936bf6 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:30.769074 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e7fa716a-448c-45b3-9c17-b6695f936bf6 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:30.769650 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e7fa716a-448c-45b3-9c17-b6695f936bf6 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:30.770085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e7fa716a-448c-45b3-9c17-b6695f936bf6 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:30.770799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e7fa716a-448c-45b3-9c17-b6695f936bf6 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:30.771249 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e7fa716a-448c-45b3-9c17-b6695f936bf6 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:30.771790 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e7fa716a-448c-45b3-9c17-b6695f936bf6 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:30.854807 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e7fa716a-448c-45b3-9c17-b6695f936bf6 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:30.864369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e7fa716a-448c-45b3-9c17-b6695f936bf6 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1288 microversion: 2.1 time: 0.106392 Aug 18 12:22:30.875607 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 135/267] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:30 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:30.936337 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6fbc540e-d57c-46b7-983b-926b788a481d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:30.936956 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-6fbc540e-d57c-46b7-983b-926b788a481d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:30.943495 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fbc540e-d57c-46b7-983b-926b788a481d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:30.943986 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fbc540e-d57c-46b7-983b-926b788a481d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:30.944549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fbc540e-d57c-46b7-983b-926b788a481d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:30.945118 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fbc540e-d57c-46b7-983b-926b788a481d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:30.945572 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fbc540e-d57c-46b7-983b-926b788a481d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:30.946295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fbc540e-d57c-46b7-983b-926b788a481d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:30.974240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:30.975748 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:30.988171 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:30.990581 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:30.991245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:30.992186 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:30.994891 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:30.995585 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:31.006237 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=100 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:31.220278 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:31.230446 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:31.232020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:31.234059 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f25e9dcf-0c03-416e-913f-0a79af8ba54f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.265078 Aug 18 12:22:31.249117 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 136/268] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:30 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:31.249117 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d015cfcd-bac4-41df-b202-4ba446168f9e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:31.249117 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d015cfcd-bac4-41df-b202-4ba446168f9e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:31.249117 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d015cfcd-bac4-41df-b202-4ba446168f9e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:31.249972 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d015cfcd-bac4-41df-b202-4ba446168f9e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:31.249972 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d015cfcd-bac4-41df-b202-4ba446168f9e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:31.249972 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d015cfcd-bac4-41df-b202-4ba446168f9e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:31.249972 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d015cfcd-bac4-41df-b202-4ba446168f9e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:31.250415 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d015cfcd-bac4-41df-b202-4ba446168f9e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:31.326341 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6fbc540e-d57c-46b7-983b-926b788a481d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:31.335020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6fbc540e-d57c-46b7-983b-926b788a481d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.403126 Aug 18 12:22:31.335866 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 133/269] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:30 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:31.393653 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d015cfcd-bac4-41df-b202-4ba446168f9e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:31.401359 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d015cfcd-bac4-41df-b202-4ba446168f9e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1517 microversion: 2.1 time: 0.165352 Aug 18 12:22:31.401934 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 137/270] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:31 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:31.886969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-281ab657-1ce6-4a85-84eb-befce25937a3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:31.887623 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-281ab657-1ce6-4a85-84eb-befce25937a3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:31.894626 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-281ab657-1ce6-4a85-84eb-befce25937a3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:31.894895 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-281ab657-1ce6-4a85-84eb-befce25937a3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:31.895332 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-281ab657-1ce6-4a85-84eb-befce25937a3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:31.896055 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-281ab657-1ce6-4a85-84eb-befce25937a3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:31.896510 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-281ab657-1ce6-4a85-84eb-befce25937a3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:31.896935 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-281ab657-1ce6-4a85-84eb-befce25937a3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:32.035944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-281ab657-1ce6-4a85-84eb-befce25937a3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:32.049096 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-281ab657-1ce6-4a85-84eb-befce25937a3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.165854 Aug 18 12:22:32.049945 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 134/271] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:31 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:32.256928 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:32.257533 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:32.264005 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:32.264542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:32.264976 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:32.265676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:32.266126 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:32.266547 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:32.358289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5014567a-910c-4fe6-b650-9d4569645fca tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:32.359147 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5014567a-910c-4fe6-b650-9d4569645fca tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:32.365769 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5014567a-910c-4fe6-b650-9d4569645fca tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:32.366524 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5014567a-910c-4fe6-b650-9d4569645fca tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:32.366951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5014567a-910c-4fe6-b650-9d4569645fca tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:32.368156 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5014567a-910c-4fe6-b650-9d4569645fca tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:32.368607 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5014567a-910c-4fe6-b650-9d4569645fca tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:32.369169 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5014567a-910c-4fe6-b650-9d4569645fca tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:32.419282 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:32.428646 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:32.430500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:32.431765 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fb0ebfc9-f044-4273-990a-64598197b1d4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.178891 Aug 18 12:22:32.432652 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 138/272] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:32 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:32.515834 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5014567a-910c-4fe6-b650-9d4569645fca tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:32.524655 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5014567a-910c-4fe6-b650-9d4569645fca tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.171318 Aug 18 12:22:32.525234 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 135/273] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:32 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:33.069996 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c60b1615-0970-40c4-ad44-b3e3df18f348 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:33.075690 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c60b1615-0970-40c4-ad44-b3e3df18f348 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:33.077108 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c60b1615-0970-40c4-ad44-b3e3df18f348 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:33.077746 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c60b1615-0970-40c4-ad44-b3e3df18f348 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:33.078180 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c60b1615-0970-40c4-ad44-b3e3df18f348 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:33.078886 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c60b1615-0970-40c4-ad44-b3e3df18f348 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:33.079369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c60b1615-0970-40c4-ad44-b3e3df18f348 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:33.079755 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c60b1615-0970-40c4-ad44-b3e3df18f348 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:33.279107 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c60b1615-0970-40c4-ad44-b3e3df18f348 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:33.287463 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c60b1615-0970-40c4-ad44-b3e3df18f348 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.221313 Aug 18 12:22:33.288523 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 139/274] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:33 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:33.454450 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:33.455089 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:33.461558 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:33.462047 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:33.462485 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:33.463179 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:33.463660 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:33.464087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:33.546601 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bb22b0dc-148f-456e-b891-ae98008159ba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:33.547247 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bb22b0dc-148f-456e-b891-ae98008159ba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:33.553370 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb22b0dc-148f-456e-b891-ae98008159ba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:33.553858 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb22b0dc-148f-456e-b891-ae98008159ba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:33.554290 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb22b0dc-148f-456e-b891-ae98008159ba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:33.554990 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb22b0dc-148f-456e-b891-ae98008159ba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:33.555461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb22b0dc-148f-456e-b891-ae98008159ba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:33.555888 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb22b0dc-148f-456e-b891-ae98008159ba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:33.614844 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:33.623193 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:33.624737 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:33.625853 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ccdc1529-4506-4898-b3a3-ef184c7e258a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.175462 Aug 18 12:22:33.626412 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 136/275] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:33 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:33.697952 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bb22b0dc-148f-456e-b891-ae98008159ba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:33.707744 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-bb22b0dc-148f-456e-b891-ae98008159ba tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.165535 Aug 18 12:22:33.708380 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 140/276] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:33 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:34.308226 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-034a3f82-f935-4e0a-954f-a44f21e1963f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:34.308845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-034a3f82-f935-4e0a-954f-a44f21e1963f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:34.311992 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=4 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:34.312969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:34.316559 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-034a3f82-f935-4e0a-954f-a44f21e1963f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:34.320334 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-034a3f82-f935-4e0a-954f-a44f21e1963f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:34.320334 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-034a3f82-f935-4e0a-954f-a44f21e1963f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:34.320334 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-034a3f82-f935-4e0a-954f-a44f21e1963f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:34.320334 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-034a3f82-f935-4e0a-954f-a44f21e1963f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:34.320682 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-034a3f82-f935-4e0a-954f-a44f21e1963f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:34.323232 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:34.639315 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-034a3f82-f935-4e0a-954f-a44f21e1963f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:34.648959 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-034a3f82-f935-4e0a-954f-a44f21e1963f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.344021 Aug 18 12:22:34.650272 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:34.662150 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:34.662150 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=6 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:34.662150 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:34.662150 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:34.662538 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:34.662538 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:34.662927 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:34.663664 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:34.664148 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 137/277] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:34 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:34.733916 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-21133893-bc0c-4e8d-82a0-c63e5c25c9a0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:34.736460 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-21133893-bc0c-4e8d-82a0-c63e5c25c9a0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:34.767658 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21133893-bc0c-4e8d-82a0-c63e5c25c9a0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:34.767658 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21133893-bc0c-4e8d-82a0-c63e5c25c9a0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:34.767658 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21133893-bc0c-4e8d-82a0-c63e5c25c9a0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:34.767658 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21133893-bc0c-4e8d-82a0-c63e5c25c9a0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:34.767991 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21133893-bc0c-4e8d-82a0-c63e5c25c9a0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:34.767991 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21133893-bc0c-4e8d-82a0-c63e5c25c9a0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:34.894522 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:34.960517 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:34.960517 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:34.960517 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-62aec213-9152-4ced-8b60-3f7c2737161c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.298508 Aug 18 12:22:34.960820 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 141/278] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:34 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:35.144863 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-21133893-bc0c-4e8d-82a0-c63e5c25c9a0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:35.153065 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-21133893-bc0c-4e8d-82a0-c63e5c25c9a0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.427059 Aug 18 12:22:35.153636 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 138/279] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:34 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:35.674927 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e9d1244a-2dae-4c51-844b-44e1a5b108f0 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:35.674927 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e9d1244a-2dae-4c51-844b-44e1a5b108f0 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:35.679564 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e9d1244a-2dae-4c51-844b-44e1a5b108f0 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:35.682352 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e9d1244a-2dae-4c51-844b-44e1a5b108f0 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:35.682872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e9d1244a-2dae-4c51-844b-44e1a5b108f0 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:35.686078 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e9d1244a-2dae-4c51-844b-44e1a5b108f0 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:35.687222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e9d1244a-2dae-4c51-844b-44e1a5b108f0 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:35.688153 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e9d1244a-2dae-4c51-844b-44e1a5b108f0 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:35.921618 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e9d1244a-2dae-4c51-844b-44e1a5b108f0 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:35.934449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e9d1244a-2dae-4c51-844b-44e1a5b108f0 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.267429 Aug 18 12:22:35.935821 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 142/280] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:35 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:35.974902 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:35.976140 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:35.978701 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=18 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:35.984983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:35.985429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:35.985870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:35.986576 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:35.987035 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:35.987722 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:36.099751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-a2651096-df0c-424c-b6ef-79f1ebe7422f req-b30e514d-b7e9-42a2-bb35-01dbed346625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2758c03-8b2c-4e3a-aed6-b96d385eb0c9", "tag": "dad22071-2507-4821-a285-b550d9182dc3"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:36.109653 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-a2651096-df0c-424c-b6ef-79f1ebe7422f req-b30e514d-b7e9-42a2-bb35-01dbed346625 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:36.110577 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-a2651096-df0c-424c-b6ef-79f1ebe7422f req-b30e514d-b7e9-42a2-bb35-01dbed346625 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:36.112493 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-a2651096-df0c-424c-b6ef-79f1ebe7422f req-b30e514d-b7e9-42a2-bb35-01dbed346625 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:36.132680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-a2651096-df0c-424c-b6ef-79f1ebe7422f req-b30e514d-b7e9-42a2-bb35-01dbed346625 service nova] Creating event network-changed:dad22071-2507-4821-a285-b550d9182dc3 for instance a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 on hv-cinder-83602 Aug 18 12:22:36.137544 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:36.139225 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-a2651096-df0c-424c-b6ef-79f1ebe7422f req-b30e514d-b7e9-42a2-bb35-01dbed346625 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042867 Aug 18 12:22:36.139854 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 143/281] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:22:36.146761 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:36.148414 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:36.149785 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-433def13-4d46-41f0-84b9-e8360541f7bf tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.179097 Aug 18 12:22:36.150358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 139/282] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:35 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:36.175904 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-33612a7e-be4b-41b2-957f-15fe79ea0922 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:36.176601 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-33612a7e-be4b-41b2-957f-15fe79ea0922 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:36.183018 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33612a7e-be4b-41b2-957f-15fe79ea0922 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:36.183540 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33612a7e-be4b-41b2-957f-15fe79ea0922 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:36.184082 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33612a7e-be4b-41b2-957f-15fe79ea0922 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:36.185421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33612a7e-be4b-41b2-957f-15fe79ea0922 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:36.185884 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33612a7e-be4b-41b2-957f-15fe79ea0922 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:36.186307 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33612a7e-be4b-41b2-957f-15fe79ea0922 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:36.282668 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0a425e5a-b8c3-4a26-ae7f-6364282cfc0f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Action: 'create', calling method: .version_select at 0x7f3794a16310>, body: {"keypair": {"name": "tempest-keypair-413295309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4vCmcX/nQzNDyCZzYWx8Nif9Yj4tNdht5/zyF/oak2lwu4wpDZ3Fyro0yum/K+yA86IQ5xfV0dbyMi4aAyfTB+uqRhgpCIN3as3no8uIvIeO0LxW1vmKgL3pAPUN2AoQ=="}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:36.300527 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-0a425e5a-b8c3-4a26-ae7f-6364282cfc0f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Getting quotas for project 965cf5f488364e0ea8b52cdc78de2641. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:22:36.306230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-0a425e5a-b8c3-4a26-ae7f-6364282cfc0f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Getting quotas for user 2e8380a466484c83bca842518d171048 and project 965cf5f488364e0ea8b52cdc78de2641. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:22:36.359185 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-33612a7e-be4b-41b2-957f-15fe79ea0922 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:36.371252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-33612a7e-be4b-41b2-957f-15fe79ea0922 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.198938 Aug 18 12:22:36.372166 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 144/283] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:36 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:36.403730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0a425e5a-b8c3-4a26-ae7f-6364282cfc0f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125054 Aug 18 12:22:36.404906 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 140/284] 10.222.0.98 () {60 vars in 1159 bytes} [Thu Aug 18 12:22:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:22:36.956923 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-43d93e3a-1ac7-4f70-b443-3ee955a988b3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:36.957578 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-43d93e3a-1ac7-4f70-b443-3ee955a988b3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:36.960173 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=92 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:36.969758 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-43d93e3a-1ac7-4f70-b443-3ee955a988b3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:36.971201 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-43d93e3a-1ac7-4f70-b443-3ee955a988b3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:36.971724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-43d93e3a-1ac7-4f70-b443-3ee955a988b3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:36.972742 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-43d93e3a-1ac7-4f70-b443-3ee955a988b3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:36.973342 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-43d93e3a-1ac7-4f70-b443-3ee955a988b3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:36.973925 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-43d93e3a-1ac7-4f70-b443-3ee955a988b3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:37.172692 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:37.174802 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:37.182346 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:37.182830 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:37.183453 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:37.184585 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:37.186108 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:37.187290 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:37.408012 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-43d93e3a-1ac7-4f70-b443-3ee955a988b3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:37.417897 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-43d93e3a-1ac7-4f70-b443-3ee955a988b3 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.466988 Aug 18 12:22:37.433450 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 145/285] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:36 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:37.433450 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b79d630a-06d9-4ec1-9da9-75fc28d7c73a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:37.433450 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b79d630a-06d9-4ec1-9da9-75fc28d7c73a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:37.437339 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b79d630a-06d9-4ec1-9da9-75fc28d7c73a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:37.437825 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b79d630a-06d9-4ec1-9da9-75fc28d7c73a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:37.438309 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b79d630a-06d9-4ec1-9da9-75fc28d7c73a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:37.439009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b79d630a-06d9-4ec1-9da9-75fc28d7c73a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:37.439472 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b79d630a-06d9-4ec1-9da9-75fc28d7c73a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:37.439959 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b79d630a-06d9-4ec1-9da9-75fc28d7c73a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:37.530295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:37.544326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:37.546058 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:37.547371 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8aa13ddf-36be-4619-80d0-741e6fc8cb03 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.379570 Aug 18 12:22:37.548365 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 141/286] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:37 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:37.710724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b79d630a-06d9-4ec1-9da9-75fc28d7c73a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:37.722073 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b79d630a-06d9-4ec1-9da9-75fc28d7c73a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.296514 Aug 18 12:22:37.724910 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 146/287] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:37 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:38.441372 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a2d8fec9-7a86-4143-b819-23675f063e68 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:38.443246 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a2d8fec9-7a86-4143-b819-23675f063e68 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:38.450516 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a2d8fec9-7a86-4143-b819-23675f063e68 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:38.451261 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a2d8fec9-7a86-4143-b819-23675f063e68 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:38.451882 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a2d8fec9-7a86-4143-b819-23675f063e68 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:38.452840 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a2d8fec9-7a86-4143-b819-23675f063e68 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:38.453453 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a2d8fec9-7a86-4143-b819-23675f063e68 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:38.454068 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a2d8fec9-7a86-4143-b819-23675f063e68 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:38.570296 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:38.570937 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:38.578317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:38.578789 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:38.579219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:38.579985 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:38.580436 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:38.580851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:38.696384 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a2d8fec9-7a86-4143-b819-23675f063e68 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:38.709481 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a2d8fec9-7a86-4143-b819-23675f063e68 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.272082 Aug 18 12:22:38.710346 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 142/288] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:38 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:38.753787 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6fdc97ed-276c-453c-8c17-8ba8e0ce7759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:38.755002 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-6fdc97ed-276c-453c-8c17-8ba8e0ce7759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:38.765195 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fdc97ed-276c-453c-8c17-8ba8e0ce7759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:38.765880 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fdc97ed-276c-453c-8c17-8ba8e0ce7759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:38.767210 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fdc97ed-276c-453c-8c17-8ba8e0ce7759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:38.768261 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fdc97ed-276c-453c-8c17-8ba8e0ce7759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:38.768942 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fdc97ed-276c-453c-8c17-8ba8e0ce7759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:38.770439 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6fdc97ed-276c-453c-8c17-8ba8e0ce7759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:39.050934 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6fdc97ed-276c-453c-8c17-8ba8e0ce7759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:39.065817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6fdc97ed-276c-453c-8c17-8ba8e0ce7759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.319372 Aug 18 12:22:39.069541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 143/289] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:38 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:39.094265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:39.104227 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:39.106061 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:39.107996 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8948c1f6-fb8f-4f71-afb0-85cce71182b2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.541124 Aug 18 12:22:39.114032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 147/290] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:38 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:22:39.730360 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-53b0c73d-0856-4b18-96c4-d7d4b3f08898 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:39.730974 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-53b0c73d-0856-4b18-96c4-d7d4b3f08898 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:39.739696 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53b0c73d-0856-4b18-96c4-d7d4b3f08898 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:39.740187 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53b0c73d-0856-4b18-96c4-d7d4b3f08898 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:39.740628 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53b0c73d-0856-4b18-96c4-d7d4b3f08898 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:39.741328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53b0c73d-0856-4b18-96c4-d7d4b3f08898 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:39.741805 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53b0c73d-0856-4b18-96c4-d7d4b3f08898 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:39.742224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53b0c73d-0856-4b18-96c4-d7d4b3f08898 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:39.972691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-53b0c73d-0856-4b18-96c4-d7d4b3f08898 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:39.996459 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-53b0c73d-0856-4b18-96c4-d7d4b3f08898 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.269156 Aug 18 12:22:39.999198 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 144/291] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:39 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:40.087762 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d2067286-27cd-4d48-b3ec-89aacb075ded tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:40.089055 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d2067286-27cd-4d48-b3ec-89aacb075ded tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:40.096758 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d2067286-27cd-4d48-b3ec-89aacb075ded tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:40.097502 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d2067286-27cd-4d48-b3ec-89aacb075ded tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:40.098152 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d2067286-27cd-4d48-b3ec-89aacb075ded tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:40.099588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d2067286-27cd-4d48-b3ec-89aacb075ded tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:40.100479 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d2067286-27cd-4d48-b3ec-89aacb075ded tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:40.101097 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d2067286-27cd-4d48-b3ec-89aacb075ded tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:40.136771 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:40.137513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:40.151381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:40.151923 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:40.152368 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:40.153129 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:40.154733 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:40.156163 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:40.344549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d2067286-27cd-4d48-b3ec-89aacb075ded tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:40.354410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d2067286-27cd-4d48-b3ec-89aacb075ded tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.271965 Aug 18 12:22:40.372011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 148/292] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:40 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:40.381160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-758393093", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fa2d47f-8432-41a3-92d6-82fa0a5852d4"}], "security_groups": [{"name": "tempest-securitygroup--918005493"}], "key_name": "tempest-keypair-413295309", "user_data": "}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:40.457248 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:40.467015 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:40.469387 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:40.470625 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-bf6dc00a-bfd1-4106-8bdd-a525a03ee101 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.340445 Aug 18 12:22:40.471771 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 145/293] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:40 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:22:40.510821 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.network.neutron [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] validate_networks() for [('4fa2d47f-8432-41a3-92d6-82fa0a5852d4', None, None, None, None, None)] {{(pid=121245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:22:40.921247 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Flavor limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:22:40.921929 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Image limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:22:40.932463 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Flavor pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:22:40.932463 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Image pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:22:40.932463 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:22:40.940329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:40.941071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:40.941722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:40.955784 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:40.956384 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:40.958647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:40.989542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Getting quotas for project 965cf5f488364e0ea8b52cdc78de2641. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:22:40.998925 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Getting quotas for user 2e8380a466484c83bca842518d171048 and project 965cf5f488364e0ea8b52cdc78de2641. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:22:41.012705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Going to run 1 instances... {{(pid=121245) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:22:41.016725 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:22:41.019571 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-304fa8b2-94f2-4923-ae2d-9b5596147d80 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:41.020800 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-304fa8b2-94f2-4923-ae2d-9b5596147d80 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:41.034228 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-304fa8b2-94f2-4923-ae2d-9b5596147d80 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:41.034891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-304fa8b2-94f2-4923-ae2d-9b5596147d80 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:41.035581 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-304fa8b2-94f2-4923-ae2d-9b5596147d80 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:41.043134 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-304fa8b2-94f2-4923-ae2d-9b5596147d80 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:41.043134 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-304fa8b2-94f2-4923-ae2d-9b5596147d80 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:41.043134 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-304fa8b2-94f2-4923-ae2d-9b5596147d80 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:41.182180 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-304fa8b2-94f2-4923-ae2d-9b5596147d80 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:41.190228 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-304fa8b2-94f2-4923-ae2d-9b5596147d80 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.174598 Aug 18 12:22:41.190906 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 146/294] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:41 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:41.221465 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8ee6e021-49ed-4d3a-9ed8-1813a7191e48 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.847036 Aug 18 12:22:41.222337 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 149/295] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:22:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:22:41.234534 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-eee152b3-52d0-435e-a98b-a40a37d2b51c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:41.235358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-eee152b3-52d0-435e-a98b-a40a37d2b51c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:41.313007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-eee152b3-52d0-435e-a98b-a40a37d2b51c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:41.323636 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-eee152b3-52d0-435e-a98b-a40a37d2b51c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1244 microversion: 2.1 time: 0.094266 Aug 18 12:22:41.342569 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 147/296] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:41 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1244 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:41.377311 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-9f3077f7-3f79-484d-9a8f-1651bfa78dbd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:41.378894 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-9f3077f7-3f79-484d-9a8f-1651bfa78dbd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:41.386184 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f3077f7-3f79-484d-9a8f-1651bfa78dbd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:41.386685 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f3077f7-3f79-484d-9a8f-1651bfa78dbd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:41.388122 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f3077f7-3f79-484d-9a8f-1651bfa78dbd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:41.390212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f3077f7-3f79-484d-9a8f-1651bfa78dbd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:41.390681 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f3077f7-3f79-484d-9a8f-1651bfa78dbd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:41.391112 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f3077f7-3f79-484d-9a8f-1651bfa78dbd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:41.496430 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:41.497046 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:41.504256 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:41.504745 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:41.505609 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:41.506318 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:41.506772 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:41.507199 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:41.577874 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-9f3077f7-3f79-484d-9a8f-1651bfa78dbd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:41.596945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-9f3077f7-3f79-484d-9a8f-1651bfa78dbd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.224391 Aug 18 12:22:41.598637 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 150/297] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:41 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:41.669021 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:41.680357 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:41.682028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:41.683243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f3dfc81d-3ad9-4a3c-8f89-c3782e1475b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.191179 Aug 18 12:22:41.683902 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 148/298] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:41 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:22:42.211746 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-62647bc5-5338-4d64-ba4f-7b1da8c5545a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:42.212629 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-62647bc5-5338-4d64-ba4f-7b1da8c5545a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:42.220619 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62647bc5-5338-4d64-ba4f-7b1da8c5545a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:42.221357 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62647bc5-5338-4d64-ba4f-7b1da8c5545a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:42.221857 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62647bc5-5338-4d64-ba4f-7b1da8c5545a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:42.223564 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62647bc5-5338-4d64-ba4f-7b1da8c5545a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:42.224292 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62647bc5-5338-4d64-ba4f-7b1da8c5545a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:42.225026 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62647bc5-5338-4d64-ba4f-7b1da8c5545a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:42.346283 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-65c8469e-06ca-4a4a-a249-62f8ea483038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:42.347897 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-65c8469e-06ca-4a4a-a249-62f8ea483038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:42.421977 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-65c8469e-06ca-4a4a-a249-62f8ea483038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:42.430296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-65c8469e-06ca-4a4a-a249-62f8ea483038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1244 microversion: 2.1 time: 0.089288 Aug 18 12:22:42.431267 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 149/299] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:42 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:42.471800 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-62647bc5-5338-4d64-ba4f-7b1da8c5545a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:42.497370 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-62647bc5-5338-4d64-ba4f-7b1da8c5545a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.289368 Aug 18 12:22:42.499141 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 151/300] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:42 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:42.587205 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-994321fe-ca2f-4252-b260-7725ba4f6cb3 req-78f17072-ef4f-41c4-9afa-ea7986d58161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4dfc92-fb5b-46f3-a14a-992de65d7adb", "name": "network-vif-plugged", "status": "completed", "tag": "45eda560-60cf-411c-954a-1838984f4e8f"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:42.600722 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-994321fe-ca2f-4252-b260-7725ba4f6cb3 req-78f17072-ef4f-41c4-9afa-ea7986d58161 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:42.602476 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-994321fe-ca2f-4252-b260-7725ba4f6cb3 req-78f17072-ef4f-41c4-9afa-ea7986d58161 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:42.603621 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-994321fe-ca2f-4252-b260-7725ba4f6cb3 req-78f17072-ef4f-41c4-9afa-ea7986d58161 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:42.622856 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-db1224a3-413f-435c-a1e1-fa69cdd74a2a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:42.624465 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-db1224a3-413f-435c-a1e1-fa69cdd74a2a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:42.625708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-994321fe-ca2f-4252-b260-7725ba4f6cb3 req-78f17072-ef4f-41c4-9afa-ea7986d58161 service nova] Creating event network-vif-plugged:45eda560-60cf-411c-954a-1838984f4e8f for instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb on hv-cinder-83602 Aug 18 12:22:42.631249 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-994321fe-ca2f-4252-b260-7725ba4f6cb3 req-78f17072-ef4f-41c4-9afa-ea7986d58161 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047907 Aug 18 12:22:42.631887 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 150/301] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:22:42.633026 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db1224a3-413f-435c-a1e1-fa69cdd74a2a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:42.633622 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db1224a3-413f-435c-a1e1-fa69cdd74a2a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:42.634266 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db1224a3-413f-435c-a1e1-fa69cdd74a2a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:42.634994 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db1224a3-413f-435c-a1e1-fa69cdd74a2a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:42.635901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db1224a3-413f-435c-a1e1-fa69cdd74a2a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:42.636365 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db1224a3-413f-435c-a1e1-fa69cdd74a2a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:42.708004 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:42.708706 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:42.715921 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:42.717286 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:42.721718 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:42.721718 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:42.721718 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:42.721718 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:42.918497 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-db1224a3-413f-435c-a1e1-fa69cdd74a2a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:42.921730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:42.928196 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-db1224a3-413f-435c-a1e1-fa69cdd74a2a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1722 microversion: 2.1 time: 0.313351 Aug 18 12:22:42.930891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:42.932919 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 152/302] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:42 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:42.933050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:42.936655 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d5b34b38-38f7-40a7-8d69-86d445ca0f9f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.231963 Aug 18 12:22:42.937562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 151/303] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:42 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:22:43.453726 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fcf84d5b-0642-41cc-8e30-911a8fd040ae tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:43.454377 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fcf84d5b-0642-41cc-8e30-911a8fd040ae tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:43.466925 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf84d5b-0642-41cc-8e30-911a8fd040ae tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:43.467469 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf84d5b-0642-41cc-8e30-911a8fd040ae tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:43.471134 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf84d5b-0642-41cc-8e30-911a8fd040ae tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:43.472115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf84d5b-0642-41cc-8e30-911a8fd040ae tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:43.472637 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf84d5b-0642-41cc-8e30-911a8fd040ae tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:43.476334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf84d5b-0642-41cc-8e30-911a8fd040ae tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:43.519033 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-db0889f7-8e33-4d03-bf5a-03836e67185f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:43.519817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-db0889f7-8e33-4d03-bf5a-03836e67185f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:43.530732 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db0889f7-8e33-4d03-bf5a-03836e67185f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:43.532038 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db0889f7-8e33-4d03-bf5a-03836e67185f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:43.533686 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db0889f7-8e33-4d03-bf5a-03836e67185f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:43.534382 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db0889f7-8e33-4d03-bf5a-03836e67185f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:43.535029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db0889f7-8e33-4d03-bf5a-03836e67185f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:43.535698 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db0889f7-8e33-4d03-bf5a-03836e67185f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:43.599380 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fcf84d5b-0642-41cc-8e30-911a8fd040ae tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:43.610303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fcf84d5b-0642-41cc-8e30-911a8fd040ae tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1296 microversion: 2.1 time: 0.161644 Aug 18 12:22:43.613562 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 153/304] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:43 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1296 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:43.833861 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-db0889f7-8e33-4d03-bf5a-03836e67185f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:43.842096 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-db0889f7-8e33-4d03-bf5a-03836e67185f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.326898 Aug 18 12:22:43.843191 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 152/305] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:43 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:43.956395 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c81362da-d424-4c93-86ce-830bfd028cd0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:43.957376 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c81362da-d424-4c93-86ce-830bfd028cd0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:43.959154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:43.960094 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:43.965976 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c81362da-d424-4c93-86ce-830bfd028cd0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:43.966863 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c81362da-d424-4c93-86ce-830bfd028cd0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:43.967265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:43.967785 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:43.968069 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c81362da-d424-4c93-86ce-830bfd028cd0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:43.968220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:43.969165 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c81362da-d424-4c93-86ce-830bfd028cd0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:43.969791 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c81362da-d424-4c93-86ce-830bfd028cd0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:43.971016 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c81362da-d424-4c93-86ce-830bfd028cd0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:43.973387 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:43.973877 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:43.974313 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:43.978415 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=100 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:44.141199 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c81362da-d424-4c93-86ce-830bfd028cd0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:44.149768 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c81362da-d424-4c93-86ce-830bfd028cd0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1699 microversion: 2.1 time: 0.199867 Aug 18 12:22:44.150339 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 154/306] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:43 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1699 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:44.174284 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-af7d56f6-8c00-4b73-a24d-680e04d61f18 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:44.180946 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-af7d56f6-8c00-4b73-a24d-680e04d61f18 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:44.181724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-af7d56f6-8c00-4b73-a24d-680e04d61f18 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:44.182350 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-af7d56f6-8c00-4b73-a24d-680e04d61f18 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:44.262576 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-af7d56f6-8c00-4b73-a24d-680e04d61f18 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Going to try to start instance {{(pid=121245) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 18 12:22:44.327819 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:44.338102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:44.340229 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:44.341416 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5a522b96-2c88-4838-9ad7-4b639187c645 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.386134 Aug 18 12:22:44.342886 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 153/307] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:43 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:44.521651 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-af7d56f6-8c00-4b73-a24d-680e04d61f18 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "POST /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/action" status: 202 len: 0 microversion: 2.1 time: 0.352294 Aug 18 12:22:44.524332 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 155/308] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:22:44 2022] POST /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:22:44.533271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8475f204-1131-4b8d-8f8c-3b0f4707b7a5 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:44.534106 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8475f204-1131-4b8d-8f8c-3b0f4707b7a5 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:44.542397 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8475f204-1131-4b8d-8f8c-3b0f4707b7a5 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:44.543150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8475f204-1131-4b8d-8f8c-3b0f4707b7a5 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:44.544145 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8475f204-1131-4b8d-8f8c-3b0f4707b7a5 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:44.545594 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8475f204-1131-4b8d-8f8c-3b0f4707b7a5 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:44.546205 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8475f204-1131-4b8d-8f8c-3b0f4707b7a5 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:44.546797 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8475f204-1131-4b8d-8f8c-3b0f4707b7a5 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:44.634977 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0907e01b-213f-41df-979e-561fe76cf1b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:44.635932 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0907e01b-213f-41df-979e-561fe76cf1b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:44.643375 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0907e01b-213f-41df-979e-561fe76cf1b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:44.644549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0907e01b-213f-41df-979e-561fe76cf1b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:44.644998 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0907e01b-213f-41df-979e-561fe76cf1b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:44.646205 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0907e01b-213f-41df-979e-561fe76cf1b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:44.646668 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0907e01b-213f-41df-979e-561fe76cf1b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:44.647284 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0907e01b-213f-41df-979e-561fe76cf1b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:44.719188 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0907e01b-213f-41df-979e-561fe76cf1b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:44.726627 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0907e01b-213f-41df-979e-561fe76cf1b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1296 microversion: 2.1 time: 0.095974 Aug 18 12:22:44.727453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 156/309] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:44 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:44.748241 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8475f204-1131-4b8d-8f8c-3b0f4707b7a5 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:44.756623 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8475f204-1131-4b8d-8f8c-3b0f4707b7a5 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1708 microversion: 2.1 time: 0.228264 Aug 18 12:22:44.757298 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 154/310] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:44 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1708 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:44.863155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e419b2bd-c8df-4ed8-8c40-a6ff3f05a745 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:44.863867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e419b2bd-c8df-4ed8-8c40-a6ff3f05a745 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:44.870646 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e419b2bd-c8df-4ed8-8c40-a6ff3f05a745 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:44.871117 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e419b2bd-c8df-4ed8-8c40-a6ff3f05a745 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:44.871573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e419b2bd-c8df-4ed8-8c40-a6ff3f05a745 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:44.872261 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e419b2bd-c8df-4ed8-8c40-a6ff3f05a745 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:44.872868 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e419b2bd-c8df-4ed8-8c40-a6ff3f05a745 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:44.873447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e419b2bd-c8df-4ed8-8c40-a6ff3f05a745 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:45.034955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e419b2bd-c8df-4ed8-8c40-a6ff3f05a745 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:45.047910 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e419b2bd-c8df-4ed8-8c40-a6ff3f05a745 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.188973 Aug 18 12:22:45.048708 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 157/311] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:44 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:45.365992 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:45.367004 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:45.374509 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:45.375120 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:45.375710 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:45.376529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:45.377245 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:45.377768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:45.708162 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:45.721820 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:45.723650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:45.725236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2d83ab04-6a4d-41d7-9978-be89e729a6fe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.363203 Aug 18 12:22:45.726373 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 155/312] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:45 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:45.750319 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-9c9b249a-73d0-4b51-a999-3fdb9618b46c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:45.751053 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-9c9b249a-73d0-4b51-a999-3fdb9618b46c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:45.757809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9c9b249a-73d0-4b51-a999-3fdb9618b46c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:45.760144 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9c9b249a-73d0-4b51-a999-3fdb9618b46c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:45.760144 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9c9b249a-73d0-4b51-a999-3fdb9618b46c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:45.760144 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9c9b249a-73d0-4b51-a999-3fdb9618b46c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:45.760144 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9c9b249a-73d0-4b51-a999-3fdb9618b46c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:45.761078 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9c9b249a-73d0-4b51-a999-3fdb9618b46c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:45.778465 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5e3a0583-5253-4f19-bbbc-6a32af8550ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:45.779489 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5e3a0583-5253-4f19-bbbc-6a32af8550ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:45.791338 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e3a0583-5253-4f19-bbbc-6a32af8550ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:45.792415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e3a0583-5253-4f19-bbbc-6a32af8550ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:45.793081 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e3a0583-5253-4f19-bbbc-6a32af8550ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:45.794003 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e3a0583-5253-4f19-bbbc-6a32af8550ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:45.795250 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e3a0583-5253-4f19-bbbc-6a32af8550ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:45.795942 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e3a0583-5253-4f19-bbbc-6a32af8550ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:45.875155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-9c9b249a-73d0-4b51-a999-3fdb9618b46c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:45.883121 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-9c9b249a-73d0-4b51-a999-3fdb9618b46c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1296 microversion: 2.1 time: 0.138610 Aug 18 12:22:45.883940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 158/313] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:45 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1296 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:46.026082 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5e3a0583-5253-4f19-bbbc-6a32af8550ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:46.034851 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5e3a0583-5253-4f19-bbbc-6a32af8550ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1708 microversion: 2.1 time: 0.260158 Aug 18 12:22:46.035775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 156/314] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:45 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1708 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:46.067682 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7283989d-0ca0-43eb-aa9d-c39de2bc69c9 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:46.068942 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7283989d-0ca0-43eb-aa9d-c39de2bc69c9 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:46.074771 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7283989d-0ca0-43eb-aa9d-c39de2bc69c9 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:46.075242 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7283989d-0ca0-43eb-aa9d-c39de2bc69c9 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:46.075703 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7283989d-0ca0-43eb-aa9d-c39de2bc69c9 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:46.076385 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7283989d-0ca0-43eb-aa9d-c39de2bc69c9 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:46.076830 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7283989d-0ca0-43eb-aa9d-c39de2bc69c9 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:46.077240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7283989d-0ca0-43eb-aa9d-c39de2bc69c9 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:46.227075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7283989d-0ca0-43eb-aa9d-c39de2bc69c9 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:46.236815 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7283989d-0ca0-43eb-aa9d-c39de2bc69c9 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.173051 Aug 18 12:22:46.237393 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 159/315] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:46 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:46.749865 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:46.750577 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:46.757347 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:46.757839 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:46.758529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:46.759451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:46.759901 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:46.760319 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:46.780845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=100 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:46.904820 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bd8c2999-e6a4-4b53-b6c6-980c225f7afd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:46.906854 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bd8c2999-e6a4-4b53-b6c6-980c225f7afd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:46.920974 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:46.921930 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd8c2999-e6a4-4b53-b6c6-980c225f7afd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:46.922603 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd8c2999-e6a4-4b53-b6c6-980c225f7afd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:46.923395 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd8c2999-e6a4-4b53-b6c6-980c225f7afd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:46.924290 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd8c2999-e6a4-4b53-b6c6-980c225f7afd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:46.925460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd8c2999-e6a4-4b53-b6c6-980c225f7afd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:46.926045 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd8c2999-e6a4-4b53-b6c6-980c225f7afd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:46.935059 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:46.935059 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:46.935346 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-14fa2ade-c66d-46a5-9ba4-90e1f754cd15 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.190050 Aug 18 12:22:46.936360 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 157/316] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:46 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:47.017612 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bd8c2999-e6a4-4b53-b6c6-980c225f7afd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:47.026483 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-bd8c2999-e6a4-4b53-b6c6-980c225f7afd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1296 microversion: 2.1 time: 0.125531 Aug 18 12:22:47.027060 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 160/317] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:46 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1296 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:47.057642 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0dabd349-cd90-43e7-be22-35eec6dcb335 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:47.058361 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0dabd349-cd90-43e7-be22-35eec6dcb335 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:47.065998 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dabd349-cd90-43e7-be22-35eec6dcb335 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:47.066608 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dabd349-cd90-43e7-be22-35eec6dcb335 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:47.067170 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dabd349-cd90-43e7-be22-35eec6dcb335 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:47.068152 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dabd349-cd90-43e7-be22-35eec6dcb335 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:47.068768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dabd349-cd90-43e7-be22-35eec6dcb335 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:47.069412 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0dabd349-cd90-43e7-be22-35eec6dcb335 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:47.235072 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0dabd349-cd90-43e7-be22-35eec6dcb335 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:47.243991 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0dabd349-cd90-43e7-be22-35eec6dcb335 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1708 microversion: 2.1 time: 0.190325 Aug 18 12:22:47.244610 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 158/318] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:47 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1708 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:47.263840 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b31104cd-e1f7-4d95-af0d-f23a50cad887 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:47.264545 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b31104cd-e1f7-4d95-af0d-f23a50cad887 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:47.270737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b31104cd-e1f7-4d95-af0d-f23a50cad887 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:47.271303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b31104cd-e1f7-4d95-af0d-f23a50cad887 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:47.271807 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b31104cd-e1f7-4d95-af0d-f23a50cad887 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:47.272453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b31104cd-e1f7-4d95-af0d-f23a50cad887 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:47.272901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b31104cd-e1f7-4d95-af0d-f23a50cad887 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:47.273323 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b31104cd-e1f7-4d95-af0d-f23a50cad887 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:47.539265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b31104cd-e1f7-4d95-af0d-f23a50cad887 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:47.548874 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b31104cd-e1f7-4d95-af0d-f23a50cad887 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.289372 Aug 18 12:22:47.550070 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 161/319] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:47 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:47.960734 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:47.961427 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:47.968015 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:47.968884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:47.969323 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:47.970056 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:47.970542 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:47.971128 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:48.048596 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-92740073-d561-4072-9106-fbdf35a0536e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:48.049773 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-92740073-d561-4072-9106-fbdf35a0536e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:48.057796 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-92740073-d561-4072-9106-fbdf35a0536e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:48.058287 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-92740073-d561-4072-9106-fbdf35a0536e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:48.058722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-92740073-d561-4072-9106-fbdf35a0536e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:48.059909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-92740073-d561-4072-9106-fbdf35a0536e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:48.059909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-92740073-d561-4072-9106-fbdf35a0536e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:48.060468 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-92740073-d561-4072-9106-fbdf35a0536e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:48.126564 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:48.138381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:48.140218 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:48.141466 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-91bf4737-1843-40eb-b6cc-f51220a89fbe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.187176 Aug 18 12:22:48.142106 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 159/320] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:47 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:48.147097 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-92740073-d561-4072-9106-fbdf35a0536e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:48.156009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-92740073-d561-4072-9106-fbdf35a0536e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1296 microversion: 2.1 time: 0.112048 Aug 18 12:22:48.159570 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 162/321] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:48 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1296 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:48.269646 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-61ccf773-0426-4683-839c-4df25f03379e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:48.270454 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-61ccf773-0426-4683-839c-4df25f03379e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:48.276857 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61ccf773-0426-4683-839c-4df25f03379e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:48.277374 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61ccf773-0426-4683-839c-4df25f03379e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:48.278108 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61ccf773-0426-4683-839c-4df25f03379e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:48.278865 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61ccf773-0426-4683-839c-4df25f03379e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:48.281905 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61ccf773-0426-4683-839c-4df25f03379e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:48.282548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61ccf773-0426-4683-839c-4df25f03379e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:48.512186 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-61ccf773-0426-4683-839c-4df25f03379e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:48.525697 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-61ccf773-0426-4683-839c-4df25f03379e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1708 microversion: 2.1 time: 0.262879 Aug 18 12:22:48.526293 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 160/322] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:48 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1708 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:48.574074 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a45535a3-616c-46f5-bcb1-60ad410b4cc4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:48.574697 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a45535a3-616c-46f5-bcb1-60ad410b4cc4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:48.581895 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a45535a3-616c-46f5-bcb1-60ad410b4cc4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:48.582384 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a45535a3-616c-46f5-bcb1-60ad410b4cc4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:48.583978 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a45535a3-616c-46f5-bcb1-60ad410b4cc4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:48.584530 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a45535a3-616c-46f5-bcb1-60ad410b4cc4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:48.585181 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a45535a3-616c-46f5-bcb1-60ad410b4cc4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:48.585609 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a45535a3-616c-46f5-bcb1-60ad410b4cc4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:48.785087 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a45535a3-616c-46f5-bcb1-60ad410b4cc4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:48.792924 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a45535a3-616c-46f5-bcb1-60ad410b4cc4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.222568 Aug 18 12:22:48.793504 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 163/323] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:48 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:49.166749 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:49.167356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:49.175096 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:49.175907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:49.176311 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:49.177013 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:49.177505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:49.178079 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:49.179522 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2874be25-e0aa-497e-8a95-1099804d8323 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:49.188789 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-2874be25-e0aa-497e-8a95-1099804d8323 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:49.188789 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2874be25-e0aa-497e-8a95-1099804d8323 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:49.188789 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2874be25-e0aa-497e-8a95-1099804d8323 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:49.188789 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2874be25-e0aa-497e-8a95-1099804d8323 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:49.189375 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2874be25-e0aa-497e-8a95-1099804d8323 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:49.189375 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2874be25-e0aa-497e-8a95-1099804d8323 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:49.189375 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2874be25-e0aa-497e-8a95-1099804d8323 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:49.262818 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2874be25-e0aa-497e-8a95-1099804d8323 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:49.270299 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2874be25-e0aa-497e-8a95-1099804d8323 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1296 microversion: 2.1 time: 0.094765 Aug 18 12:22:49.270867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 164/324] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:49 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:49.318910 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:49.327991 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:49.329576 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:49.330709 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-7afd5f0e-f703-4b2e-b61f-d5aff6fdeb07 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1405 microversion: 2.20 time: 0.167785 Aug 18 12:22:49.331266 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 161/325] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:49 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:22:49.547658 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f3c32f20-acef-4bfa-a336-f49b59684565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:49.548266 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f3c32f20-acef-4bfa-a336-f49b59684565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:49.554322 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f3c32f20-acef-4bfa-a336-f49b59684565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:49.554816 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f3c32f20-acef-4bfa-a336-f49b59684565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:49.555816 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f3c32f20-acef-4bfa-a336-f49b59684565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:49.555993 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f3c32f20-acef-4bfa-a336-f49b59684565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:49.556426 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f3c32f20-acef-4bfa-a336-f49b59684565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:49.556848 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f3c32f20-acef-4bfa-a336-f49b59684565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:49.700980 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f3c32f20-acef-4bfa-a336-f49b59684565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:49.710992 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f3c32f20-acef-4bfa-a336-f49b59684565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1708 microversion: 2.1 time: 0.165715 Aug 18 12:22:49.725417 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 165/326] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:49 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:49.818422 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-003024ee-2a84-40a5-a843-cbb76242ebba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:49.819292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-003024ee-2a84-40a5-a843-cbb76242ebba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:49.827103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-003024ee-2a84-40a5-a843-cbb76242ebba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:49.827881 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-003024ee-2a84-40a5-a843-cbb76242ebba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:49.828486 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-003024ee-2a84-40a5-a843-cbb76242ebba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:49.829212 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-003024ee-2a84-40a5-a843-cbb76242ebba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:49.829878 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-003024ee-2a84-40a5-a843-cbb76242ebba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:49.830457 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-003024ee-2a84-40a5-a843-cbb76242ebba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:50.153479 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-003024ee-2a84-40a5-a843-cbb76242ebba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:50.176839 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-003024ee-2a84-40a5-a843-cbb76242ebba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.360855 Aug 18 12:22:50.178090 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 162/327] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:49 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:50.291778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-09f57592-00b2-4c5b-a78f-df2859bdff2a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:50.292391 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-09f57592-00b2-4c5b-a78f-df2859bdff2a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:50.299370 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09f57592-00b2-4c5b-a78f-df2859bdff2a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:50.300129 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09f57592-00b2-4c5b-a78f-df2859bdff2a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:50.300757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09f57592-00b2-4c5b-a78f-df2859bdff2a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:50.302206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09f57592-00b2-4c5b-a78f-df2859bdff2a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:50.302206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09f57592-00b2-4c5b-a78f-df2859bdff2a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:50.302943 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09f57592-00b2-4c5b-a78f-df2859bdff2a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:50.355025 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:50.356059 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:50.368929 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:50.369716 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:50.370349 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:50.371217 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:50.373372 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:50.375587 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:50.384745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-09f57592-00b2-4c5b-a78f-df2859bdff2a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:50.393136 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-09f57592-00b2-4c5b-a78f-df2859bdff2a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1304 microversion: 2.1 time: 0.105097 Aug 18 12:22:50.395628 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 166/328] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:50 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:50.536811 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-598a35ad-69ae-4045-9115-c55477c194cf req-96e244f8-de2f-46b7-b9f4-827b5b0a8706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2758c03-8b2c-4e3a-aed6-b96d385eb0c9", "name": "network-vif-plugged", "status": "completed", "tag": "dad22071-2507-4821-a285-b550d9182dc3"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:50.555680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-598a35ad-69ae-4045-9115-c55477c194cf req-96e244f8-de2f-46b7-b9f4-827b5b0a8706 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:50.572298 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-598a35ad-69ae-4045-9115-c55477c194cf req-96e244f8-de2f-46b7-b9f4-827b5b0a8706 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:50.574948 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-598a35ad-69ae-4045-9115-c55477c194cf req-96e244f8-de2f-46b7-b9f4-827b5b0a8706 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:50.606600 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-598a35ad-69ae-4045-9115-c55477c194cf req-96e244f8-de2f-46b7-b9f4-827b5b0a8706 service nova] Creating event network-vif-plugged:dad22071-2507-4821-a285-b550d9182dc3 for instance a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 on hv-cinder-83602 Aug 18 12:22:50.623049 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-598a35ad-69ae-4045-9115-c55477c194cf req-96e244f8-de2f-46b7-b9f4-827b5b0a8706 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089039 Aug 18 12:22:50.624519 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 167/329] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:22:50.737445 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-faadf0d7-8c93-41ba-863d-049bde2d4a13 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:50.738499 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-faadf0d7-8c93-41ba-863d-049bde2d4a13 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:50.748194 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-faadf0d7-8c93-41ba-863d-049bde2d4a13 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:50.749022 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-faadf0d7-8c93-41ba-863d-049bde2d4a13 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:50.749919 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-faadf0d7-8c93-41ba-863d-049bde2d4a13 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:50.750887 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-faadf0d7-8c93-41ba-863d-049bde2d4a13 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:50.751714 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-faadf0d7-8c93-41ba-863d-049bde2d4a13 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:50.752403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-faadf0d7-8c93-41ba-863d-049bde2d4a13 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:50.971714 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:51.008101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=6 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:51.202676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:51.202676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:51.203252 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:51.203252 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a1606a2d-c17e-46a3-b819-f1a737198ec6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1597 microversion: 2.20 time: 0.826547 Aug 18 12:22:51.208175 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 163/330] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:22:50 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1597 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:22:51.222305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ef78cf91-d357-421d-85c6-bc74eba737b1 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:51.227083 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ef78cf91-d357-421d-85c6-bc74eba737b1 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:51.265627 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef78cf91-d357-421d-85c6-bc74eba737b1 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:51.266367 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef78cf91-d357-421d-85c6-bc74eba737b1 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:51.266982 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef78cf91-d357-421d-85c6-bc74eba737b1 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:51.268420 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef78cf91-d357-421d-85c6-bc74eba737b1 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:51.269516 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef78cf91-d357-421d-85c6-bc74eba737b1 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:51.272817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef78cf91-d357-421d-85c6-bc74eba737b1 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:51.441823 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-faadf0d7-8c93-41ba-863d-049bde2d4a13 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:51.456558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-faadf0d7-8c93-41ba-863d-049bde2d4a13 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1708 microversion: 2.1 time: 0.722461 Aug 18 12:22:51.459567 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 168/331] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:50 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1708 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:51.479068 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3bd26dc9-c300-48fe-b881-0859b9e600b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:51.479934 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3bd26dc9-c300-48fe-b881-0859b9e600b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:51.495667 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3bd26dc9-c300-48fe-b881-0859b9e600b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:51.499197 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3bd26dc9-c300-48fe-b881-0859b9e600b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:51.499197 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3bd26dc9-c300-48fe-b881-0859b9e600b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:51.501152 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3bd26dc9-c300-48fe-b881-0859b9e600b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:51.501644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3bd26dc9-c300-48fe-b881-0859b9e600b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:51.502079 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3bd26dc9-c300-48fe-b881-0859b9e600b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:51.651467 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3bd26dc9-c300-48fe-b881-0859b9e600b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.190635 Aug 18 12:22:51.652054 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 169/332] 10.222.0.98 () {60 vars in 1316 bytes} [Thu Aug 18 12:22:51 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:22:51.665270 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bd5bce78-6a7b-4db2-91b5-185504f97dba tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:51.665872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bd5bce78-6a7b-4db2-91b5-185504f97dba tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:51.697584 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd5bce78-6a7b-4db2-91b5-185504f97dba tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:51.698396 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd5bce78-6a7b-4db2-91b5-185504f97dba tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:51.701203 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd5bce78-6a7b-4db2-91b5-185504f97dba tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:51.702221 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd5bce78-6a7b-4db2-91b5-185504f97dba tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:51.703319 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd5bce78-6a7b-4db2-91b5-185504f97dba tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:51.704365 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bd5bce78-6a7b-4db2-91b5-185504f97dba tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:52.107168 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ef78cf91-d357-421d-85c6-bc74eba737b1 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:52.130392 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ef78cf91-d357-421d-85c6-bc74eba737b1 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.916821 Aug 18 12:22:52.131688 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 164/333] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:51 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:52.490019 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=8 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:52.495258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-fd6067fa-cad5-4924-b7a1-99e44c5f17ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:52.495991 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-fd6067fa-cad5-4924-b7a1-99e44c5f17ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:52.497392 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bd5bce78-6a7b-4db2-91b5-185504f97dba tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:52.502303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:22:52.509154 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-bd5bce78-6a7b-4db2-91b5-185504f97dba tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1302 microversion: 2.1 time: 0.855750 Aug 18 12:22:52.514392 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 170/334] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:51 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1302 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:52.532969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd6067fa-cad5-4924-b7a1-99e44c5f17ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:52.539384 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd6067fa-cad5-4924-b7a1-99e44c5f17ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:52.539858 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd6067fa-cad5-4924-b7a1-99e44c5f17ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:52.540605 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd6067fa-cad5-4924-b7a1-99e44c5f17ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:52.541063 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd6067fa-cad5-4924-b7a1-99e44c5f17ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:52.549093 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd6067fa-cad5-4924-b7a1-99e44c5f17ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:52.942919 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-fd6067fa-cad5-4924-b7a1-99e44c5f17ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:52.955008 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-fd6067fa-cad5-4924-b7a1-99e44c5f17ed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1708 microversion: 2.1 time: 0.466109 Aug 18 12:22:52.968533 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 165/335] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:52 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1708 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:53.154968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-da8ff343-a9ba-4b63-bdb3-62b6976f5e22 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:53.155637 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-da8ff343-a9ba-4b63-bdb3-62b6976f5e22 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:53.183491 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8ff343-a9ba-4b63-bdb3-62b6976f5e22 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:53.183997 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8ff343-a9ba-4b63-bdb3-62b6976f5e22 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:53.184444 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8ff343-a9ba-4b63-bdb3-62b6976f5e22 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:53.223041 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8ff343-a9ba-4b63-bdb3-62b6976f5e22 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:53.224790 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8ff343-a9ba-4b63-bdb3-62b6976f5e22 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:53.226802 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-da8ff343-a9ba-4b63-bdb3-62b6976f5e22 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:53.533976 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5bc74cda-ecfa-4b36-bbce-e4902d3b10fd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:53.534677 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5bc74cda-ecfa-4b36-bbce-e4902d3b10fd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:53.549857 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5bc74cda-ecfa-4b36-bbce-e4902d3b10fd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:53.550574 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5bc74cda-ecfa-4b36-bbce-e4902d3b10fd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:53.551196 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5bc74cda-ecfa-4b36-bbce-e4902d3b10fd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:53.554275 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5bc74cda-ecfa-4b36-bbce-e4902d3b10fd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:53.554924 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5bc74cda-ecfa-4b36-bbce-e4902d3b10fd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:53.555649 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5bc74cda-ecfa-4b36-bbce-e4902d3b10fd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:53.600253 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-da8ff343-a9ba-4b63-bdb3-62b6976f5e22 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:53.602152 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-da8ff343-a9ba-4b63-bdb3-62b6976f5e22 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1318 microversion: 2.1 time: 0.451662 Aug 18 12:22:53.611561 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 171/336] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:53 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:53.820190 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-018bbcb5-c7c5-4fcd-83cf-f00764428c23 req-d4f57332-208a-47d9-ab4e-a048be929356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4dfc92-fb5b-46f3-a14a-992de65d7adb", "tag": "45eda560-60cf-411c-954a-1838984f4e8f"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:53.843176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-018bbcb5-c7c5-4fcd-83cf-f00764428c23 req-d4f57332-208a-47d9-ab4e-a048be929356 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:53.846176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-018bbcb5-c7c5-4fcd-83cf-f00764428c23 req-d4f57332-208a-47d9-ab4e-a048be929356 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:53.848902 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-018bbcb5-c7c5-4fcd-83cf-f00764428c23 req-d4f57332-208a-47d9-ab4e-a048be929356 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:53.866633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5bc74cda-ecfa-4b36-bbce-e4902d3b10fd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:53.867728 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-018bbcb5-c7c5-4fcd-83cf-f00764428c23 req-d4f57332-208a-47d9-ab4e-a048be929356 service nova] Creating event network-changed:45eda560-60cf-411c-954a-1838984f4e8f for instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb on hv-cinder-83602 Aug 18 12:22:53.876660 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5bc74cda-ecfa-4b36-bbce-e4902d3b10fd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1369 microversion: 2.1 time: 0.346802 Aug 18 12:22:53.877485 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-018bbcb5-c7c5-4fcd-83cf-f00764428c23 req-d4f57332-208a-47d9-ab4e-a048be929356 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061384 Aug 18 12:22:53.878451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 166/337] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:53 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1369 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:22:53.896011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 172/338] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:22:53.980644 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3e7a8626-bc45-4e39-87ff-f9179814908d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:53.983310 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3e7a8626-bc45-4e39-87ff-f9179814908d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:53.994175 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e7a8626-bc45-4e39-87ff-f9179814908d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:53.998414 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e7a8626-bc45-4e39-87ff-f9179814908d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:54.000501 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e7a8626-bc45-4e39-87ff-f9179814908d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:54.000501 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e7a8626-bc45-4e39-87ff-f9179814908d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:54.000896 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e7a8626-bc45-4e39-87ff-f9179814908d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:54.002980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e7a8626-bc45-4e39-87ff-f9179814908d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:54.366047 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3e7a8626-bc45-4e39-87ff-f9179814908d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:54.383393 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3e7a8626-bc45-4e39-87ff-f9179814908d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1712 microversion: 2.1 time: 0.408970 Aug 18 12:22:54.388102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 167/339] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:53 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1712 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:54.635905 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ac6e5094-a2e1-40e8-9abe-0d3d88cd1bd7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:54.636804 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ac6e5094-a2e1-40e8-9abe-0d3d88cd1bd7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:54.650928 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-b9c84fa8-abb9-40e4-a50e-67eb2e40dffb req-6f11168a-3ff5-41fa-9004-b25d0f01d78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e", "tag": "5d0b49eb-e985-4312-8c18-82dd61f5b4ea"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:22:54.676691 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ac6e5094-a2e1-40e8-9abe-0d3d88cd1bd7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:54.680403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ac6e5094-a2e1-40e8-9abe-0d3d88cd1bd7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:54.680879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ac6e5094-a2e1-40e8-9abe-0d3d88cd1bd7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:54.681635 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ac6e5094-a2e1-40e8-9abe-0d3d88cd1bd7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:54.682104 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ac6e5094-a2e1-40e8-9abe-0d3d88cd1bd7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:54.685772 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ac6e5094-a2e1-40e8-9abe-0d3d88cd1bd7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:54.696763 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-b9c84fa8-abb9-40e4-a50e-67eb2e40dffb req-6f11168a-3ff5-41fa-9004-b25d0f01d78d service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:54.699047 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-b9c84fa8-abb9-40e4-a50e-67eb2e40dffb req-6f11168a-3ff5-41fa-9004-b25d0f01d78d service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:54.699793 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-b9c84fa8-abb9-40e4-a50e-67eb2e40dffb req-6f11168a-3ff5-41fa-9004-b25d0f01d78d service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:54.737101 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-b9c84fa8-abb9-40e4-a50e-67eb2e40dffb req-6f11168a-3ff5-41fa-9004-b25d0f01d78d service nova] Creating event network-changed:5d0b49eb-e985-4312-8c18-82dd61f5b4ea for instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e on hv-cinder-83602 Aug 18 12:22:54.763115 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-b9c84fa8-abb9-40e4-a50e-67eb2e40dffb req-6f11168a-3ff5-41fa-9004-b25d0f01d78d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115616 Aug 18 12:22:54.766871 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 168/340] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:22:54.900912 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e7cb15d6-c4dc-479c-a36b-8c1da0e84349 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:54.901752 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e7cb15d6-c4dc-479c-a36b-8c1da0e84349 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:54.933242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e7cb15d6-c4dc-479c-a36b-8c1da0e84349 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:54.933242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e7cb15d6-c4dc-479c-a36b-8c1da0e84349 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:54.933242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e7cb15d6-c4dc-479c-a36b-8c1da0e84349 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:54.934213 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e7cb15d6-c4dc-479c-a36b-8c1da0e84349 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:54.936174 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e7cb15d6-c4dc-479c-a36b-8c1da0e84349 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:54.936868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e7cb15d6-c4dc-479c-a36b-8c1da0e84349 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:54.994511 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ac6e5094-a2e1-40e8-9abe-0d3d88cd1bd7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:55.007899 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ac6e5094-a2e1-40e8-9abe-0d3d88cd1bd7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1507 microversion: 2.1 time: 0.382843 Aug 18 12:22:55.008481 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 173/341] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:54 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:55.521328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e7cb15d6-c4dc-479c-a36b-8c1da0e84349 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:55.597975 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e7cb15d6-c4dc-479c-a36b-8c1da0e84349 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1369 microversion: 2.1 time: 0.646063 Aug 18 12:22:55.597975 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 169/342] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:54 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1369 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:56.616318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-adb24361-8f83-4b94-b5ef-1ae5b2501cca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:56.617397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-adb24361-8f83-4b94-b5ef-1ae5b2501cca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:56.629290 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-adb24361-8f83-4b94-b5ef-1ae5b2501cca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:56.629961 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-adb24361-8f83-4b94-b5ef-1ae5b2501cca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:56.639475 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-adb24361-8f83-4b94-b5ef-1ae5b2501cca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:56.639475 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-adb24361-8f83-4b94-b5ef-1ae5b2501cca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:56.639475 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-adb24361-8f83-4b94-b5ef-1ae5b2501cca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:56.639475 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-adb24361-8f83-4b94-b5ef-1ae5b2501cca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:56.881729 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-adb24361-8f83-4b94-b5ef-1ae5b2501cca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:56.899576 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-adb24361-8f83-4b94-b5ef-1ae5b2501cca tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1369 microversion: 2.1 time: 0.285821 Aug 18 12:22:56.901791 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 174/343] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:56 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1369 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:57.924153 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2ef3f064-e980-4013-a4f3-54696e933805 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:57.924912 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2ef3f064-e980-4013-a4f3-54696e933805 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:57.939173 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ef3f064-e980-4013-a4f3-54696e933805 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:57.939378 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ef3f064-e980-4013-a4f3-54696e933805 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:57.940014 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ef3f064-e980-4013-a4f3-54696e933805 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:57.941909 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ef3f064-e980-4013-a4f3-54696e933805 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:57.943429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ef3f064-e980-4013-a4f3-54696e933805 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:57.945464 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ef3f064-e980-4013-a4f3-54696e933805 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:58.259641 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2ef3f064-e980-4013-a4f3-54696e933805 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:58.280411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2ef3f064-e980-4013-a4f3-54696e933805 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1369 microversion: 2.1 time: 0.356421 Aug 18 12:22:58.281027 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 170/344] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:57 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1369 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:22:59.310608 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-83364fc5-0c10-48ca-8857-02f5993b172f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:22:59.311206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-83364fc5-0c10-48ca-8857-02f5993b172f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:22:59.324042 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-83364fc5-0c10-48ca-8857-02f5993b172f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:59.326190 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-83364fc5-0c10-48ca-8857-02f5993b172f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:59.327667 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-83364fc5-0c10-48ca-8857-02f5993b172f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:59.328408 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-83364fc5-0c10-48ca-8857-02f5993b172f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:22:59.329049 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-83364fc5-0c10-48ca-8857-02f5993b172f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:22:59.329645 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-83364fc5-0c10-48ca-8857-02f5993b172f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:22:59.603358 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-83364fc5-0c10-48ca-8857-02f5993b172f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:22:59.614167 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-83364fc5-0c10-48ca-8857-02f5993b172f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1369 microversion: 2.1 time: 0.308444 Aug 18 12:22:59.618322 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 175/345] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:22:59 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1369 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:00.508017 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-5ffc9ba7-d3ac-4362-9692-6e482df41b01 req-ac6d5a58-6ea3-4de7-8e54-98adc6a81ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e", "name": "network-vif-plugged", "status": "completed", "tag": "5d0b49eb-e985-4312-8c18-82dd61f5b4ea"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:00.518876 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-5ffc9ba7-d3ac-4362-9692-6e482df41b01 req-ac6d5a58-6ea3-4de7-8e54-98adc6a81ee6 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:00.519664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-5ffc9ba7-d3ac-4362-9692-6e482df41b01 req-ac6d5a58-6ea3-4de7-8e54-98adc6a81ee6 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:00.520269 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-5ffc9ba7-d3ac-4362-9692-6e482df41b01 req-ac6d5a58-6ea3-4de7-8e54-98adc6a81ee6 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:00.546028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-5ffc9ba7-d3ac-4362-9692-6e482df41b01 req-ac6d5a58-6ea3-4de7-8e54-98adc6a81ee6 service nova] Creating event network-vif-plugged:5d0b49eb-e985-4312-8c18-82dd61f5b4ea for instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e on hv-cinder-83602 Aug 18 12:23:00.561292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-5ffc9ba7-d3ac-4362-9692-6e482df41b01 req-ac6d5a58-6ea3-4de7-8e54-98adc6a81ee6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057351 Aug 18 12:23:00.565978 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 171/346] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:00.660768 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-68cb642c-21e9-45b4-9655-f82a6c19649d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:00.665455 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-68cb642c-21e9-45b4-9655-f82a6c19649d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:00.686534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68cb642c-21e9-45b4-9655-f82a6c19649d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:00.686534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68cb642c-21e9-45b4-9655-f82a6c19649d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:00.686534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68cb642c-21e9-45b4-9655-f82a6c19649d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:00.686534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68cb642c-21e9-45b4-9655-f82a6c19649d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:00.686926 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68cb642c-21e9-45b4-9655-f82a6c19649d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:00.686926 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68cb642c-21e9-45b4-9655-f82a6c19649d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:00.923625 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-68cb642c-21e9-45b4-9655-f82a6c19649d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:00.931225 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-68cb642c-21e9-45b4-9655-f82a6c19649d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1369 microversion: 2.1 time: 0.278478 Aug 18 12:23:00.933448 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 176/347] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:00 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1369 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:01.956986 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ed66737d-2a2f-442f-9d10-2ef80407833e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:01.956986 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ed66737d-2a2f-442f-9d10-2ef80407833e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:01.965266 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed66737d-2a2f-442f-9d10-2ef80407833e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:01.966101 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed66737d-2a2f-442f-9d10-2ef80407833e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:01.966397 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed66737d-2a2f-442f-9d10-2ef80407833e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:01.967265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed66737d-2a2f-442f-9d10-2ef80407833e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:01.967875 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed66737d-2a2f-442f-9d10-2ef80407833e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:01.968434 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed66737d-2a2f-442f-9d10-2ef80407833e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:02.124364 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ed66737d-2a2f-442f-9d10-2ef80407833e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:02.132509 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ed66737d-2a2f-442f-9d10-2ef80407833e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1369 microversion: 2.1 time: 0.182456 Aug 18 12:23:02.133842 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 172/348] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:01 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:03.154339 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-90615904-9c5e-4885-a03c-6e5f58b92443 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:03.155727 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-90615904-9c5e-4885-a03c-6e5f58b92443 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:03.163530 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-90615904-9c5e-4885-a03c-6e5f58b92443 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:03.164244 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-90615904-9c5e-4885-a03c-6e5f58b92443 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:03.164902 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-90615904-9c5e-4885-a03c-6e5f58b92443 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:03.166020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-90615904-9c5e-4885-a03c-6e5f58b92443 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:03.167329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-90615904-9c5e-4885-a03c-6e5f58b92443 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:03.168096 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-90615904-9c5e-4885-a03c-6e5f58b92443 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:03.346983 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-90615904-9c5e-4885-a03c-6e5f58b92443 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:03.355092 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-90615904-9c5e-4885-a03c-6e5f58b92443 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1369 microversion: 2.1 time: 0.204577 Aug 18 12:23:03.355867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 177/349] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:03 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1369 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:04.378937 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0858dceb-38a0-4ba3-82d7-538ade48dcfd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:04.379574 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0858dceb-38a0-4ba3-82d7-538ade48dcfd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:04.391583 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0858dceb-38a0-4ba3-82d7-538ade48dcfd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:04.393302 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0858dceb-38a0-4ba3-82d7-538ade48dcfd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:04.396053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0858dceb-38a0-4ba3-82d7-538ade48dcfd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:04.397013 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0858dceb-38a0-4ba3-82d7-538ade48dcfd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:04.397635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0858dceb-38a0-4ba3-82d7-538ade48dcfd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:04.399656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0858dceb-38a0-4ba3-82d7-538ade48dcfd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:04.565360 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0858dceb-38a0-4ba3-82d7-538ade48dcfd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:04.573985 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0858dceb-38a0-4ba3-82d7-538ade48dcfd tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1564 microversion: 2.1 time: 0.199884 Aug 18 12:23:04.576636 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 173/350] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:04 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1564 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:04.600364 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3778d08b-6dca-4843-b5da-16bfdff85f56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:04.600925 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3778d08b-6dca-4843-b5da-16bfdff85f56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:04.607007 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3778d08b-6dca-4843-b5da-16bfdff85f56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:04.607521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3778d08b-6dca-4843-b5da-16bfdff85f56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:04.607948 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3778d08b-6dca-4843-b5da-16bfdff85f56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:04.608828 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3778d08b-6dca-4843-b5da-16bfdff85f56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:04.609418 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3778d08b-6dca-4843-b5da-16bfdff85f56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:04.609842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3778d08b-6dca-4843-b5da-16bfdff85f56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:04.701964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3778d08b-6dca-4843-b5da-16bfdff85f56 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105222 Aug 18 12:23:04.702663 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 178/351] 10.222.0.98 () {58 vars in 1275 bytes} [Thu Aug 18 12:23:04 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:05.187099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-05a633ae-16b4-479b-984f-80f719f8f877 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Action: 'create', calling method: .version_select at 0x7f3794a08af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-568288691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGLIaIp4w+DkvuxLAiI/XR00yVMnSL3SZqF3EKDHKpGgn7sDW7+dBWDSaA9Rxw+qG71dgQOgoc75AUZl/k9Ycfsep1bacdkQu/aiLc5WTr0Dk1ycv+hqmUZtoGOHyEiOg=="}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:05.196138 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:05.205976 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-05a633ae-16b4-479b-984f-80f719f8f877 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Getting quotas for project 944cd11144ca4cbf86962a3c9494ecbd. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:23:05.211039 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-05a633ae-16b4-479b-984f-80f719f8f877 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Getting quotas for user fcc7f1b599034654a3ed64dde2145bf8 and project 944cd11144ca4cbf86962a3c9494ecbd. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:23:05.343621 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-05a633ae-16b4-479b-984f-80f719f8f877 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.160858 Aug 18 12:23:05.344234 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 174/352] 10.222.0.98 () {60 vars in 1159 bytes} [Thu Aug 18 12:23:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:05.452590 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1557570239", "imageRef": "fb9a2749-b5cd-446e-82ce-27ffa699c279", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-568288691", "networks": [{"uuid": "00aca312-8d5b-4adf-8b28-4c38cafdeb8c"}]}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:05.509652 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.network.neutron [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] validate_networks() for [('00aca312-8d5b-4adf-8b28-4c38cafdeb8c', None, None, None, None, None)] {{(pid=121245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:23:05.763483 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-7b6782e9-e6fe-4548-adbf-b56bf9ac9900 req-15948c44-1634-4509-8c08-8ff3ff46cd28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e", "tag": "5d0b49eb-e985-4312-8c18-82dd61f5b4ea"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:05.774031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-7b6782e9-e6fe-4548-adbf-b56bf9ac9900 req-15948c44-1634-4509-8c08-8ff3ff46cd28 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:05.774598 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-7b6782e9-e6fe-4548-adbf-b56bf9ac9900 req-15948c44-1634-4509-8c08-8ff3ff46cd28 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:05.775209 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-7b6782e9-e6fe-4548-adbf-b56bf9ac9900 req-15948c44-1634-4509-8c08-8ff3ff46cd28 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:05.787028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-7b6782e9-e6fe-4548-adbf-b56bf9ac9900 req-15948c44-1634-4509-8c08-8ff3ff46cd28 service nova] Creating event network-changed:5d0b49eb-e985-4312-8c18-82dd61f5b4ea for instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e on hv-cinder-83602 Aug 18 12:23:05.792609 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-7b6782e9-e6fe-4548-adbf-b56bf9ac9900 req-15948c44-1634-4509-8c08-8ff3ff46cd28 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034216 Aug 18 12:23:05.793836 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 175/353] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:23:06.121222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Flavor limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:23:06.121748 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Image limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:23:06.122223 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Flavor pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:23:06.122634 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Image pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:23:06.123044 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:23:06.132170 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:06.132640 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:06.133152 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:06.133784 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:06.134227 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:06.134782 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:06.152034 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Getting quotas for project 944cd11144ca4cbf86962a3c9494ecbd. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:23:06.156760 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Getting quotas for user fcc7f1b599034654a3ed64dde2145bf8 and project 944cd11144ca4cbf86962a3c9494ecbd. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:23:06.168831 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Going to run 1 instances... {{(pid=121245) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:23:06.171060 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb9a2749-b5cd-446e-82ce-27ffa699c279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:23:06.190731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:06.331458 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a110092e-e754-44a2-8a4b-c3776fc33cff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883255 Aug 18 12:23:06.332761 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 179/354] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:23:06.344256 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-934dbee3-36a8-46e7-931c-1b741991252d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:06.345387 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-934dbee3-36a8-46e7-931c-1b741991252d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:06.419981 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-934dbee3-36a8-46e7-931c-1b741991252d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:06.435884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-934dbee3-36a8-46e7-931c-1b741991252d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1258 microversion: 2.1 time: 0.096100 Aug 18 12:23:06.446029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 176/355] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:06 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:07.458355 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7ff01b8b-4ac5-46b4-917d-71e27f5c437d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:07.458955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7ff01b8b-4ac5-46b4-917d-71e27f5c437d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:07.511576 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7ff01b8b-4ac5-46b4-917d-71e27f5c437d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:07.518804 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7ff01b8b-4ac5-46b4-917d-71e27f5c437d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1258 microversion: 2.1 time: 0.064429 Aug 18 12:23:07.519355 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 180/356] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:07 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:08.540046 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-433a4ad6-ee95-478f-88f1-02b44c9ed4fd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:08.540656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-433a4ad6-ee95-478f-88f1-02b44c9ed4fd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:08.547826 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433a4ad6-ee95-478f-88f1-02b44c9ed4fd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:08.548301 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433a4ad6-ee95-478f-88f1-02b44c9ed4fd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:08.548732 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433a4ad6-ee95-478f-88f1-02b44c9ed4fd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:08.549573 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433a4ad6-ee95-478f-88f1-02b44c9ed4fd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:08.549858 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433a4ad6-ee95-478f-88f1-02b44c9ed4fd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:08.550269 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-433a4ad6-ee95-478f-88f1-02b44c9ed4fd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:08.613703 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-433a4ad6-ee95-478f-88f1-02b44c9ed4fd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:08.622202 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-433a4ad6-ee95-478f-88f1-02b44c9ed4fd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1310 microversion: 2.1 time: 0.085807 Aug 18 12:23:08.622792 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 177/357] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:08 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:09.646103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f8094159-f8df-4632-a2c1-eb565afd54b3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:09.646711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f8094159-f8df-4632-a2c1-eb565afd54b3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:09.652955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f8094159-f8df-4632-a2c1-eb565afd54b3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:09.653544 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f8094159-f8df-4632-a2c1-eb565afd54b3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:09.654033 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f8094159-f8df-4632-a2c1-eb565afd54b3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:09.654918 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f8094159-f8df-4632-a2c1-eb565afd54b3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:09.655458 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f8094159-f8df-4632-a2c1-eb565afd54b3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:09.655992 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f8094159-f8df-4632-a2c1-eb565afd54b3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:09.863870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f8094159-f8df-4632-a2c1-eb565afd54b3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:09.873196 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f8094159-f8df-4632-a2c1-eb565afd54b3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.230851 Aug 18 12:23:09.874163 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 181/358] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:09 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:10.894434 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5194fab4-5bcf-4f65-a6bd-44fe11f7b40a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:10.895052 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5194fab4-5bcf-4f65-a6bd-44fe11f7b40a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:10.909788 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5194fab4-5bcf-4f65-a6bd-44fe11f7b40a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:10.909788 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5194fab4-5bcf-4f65-a6bd-44fe11f7b40a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:10.914189 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5194fab4-5bcf-4f65-a6bd-44fe11f7b40a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:10.914189 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5194fab4-5bcf-4f65-a6bd-44fe11f7b40a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:10.914189 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5194fab4-5bcf-4f65-a6bd-44fe11f7b40a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:10.914189 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5194fab4-5bcf-4f65-a6bd-44fe11f7b40a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:10.916896 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=100 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:11.442689 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-3da33f3a-fe87-4732-b55c-ed147abe0d2e req-e920265e-0d12-45c7-b2c4-43a095f84491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327172e2-b2a2-479d-89f8-1810071e75ab", "tag": "1056879d-4dc9-4cb8-a5a7-372ccbc78813"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:11.451131 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5194fab4-5bcf-4f65-a6bd-44fe11f7b40a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:11.477620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5194fab4-5bcf-4f65-a6bd-44fe11f7b40a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.583642 Aug 18 12:23:11.478254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 178/359] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:10 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:11.482495 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-3da33f3a-fe87-4732-b55c-ed147abe0d2e req-e920265e-0d12-45c7-b2c4-43a095f84491 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:11.482997 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-3da33f3a-fe87-4732-b55c-ed147abe0d2e req-e920265e-0d12-45c7-b2c4-43a095f84491 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:11.483454 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-3da33f3a-fe87-4732-b55c-ed147abe0d2e req-e920265e-0d12-45c7-b2c4-43a095f84491 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:11.498396 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-3da33f3a-fe87-4732-b55c-ed147abe0d2e req-e920265e-0d12-45c7-b2c4-43a095f84491 service nova] Creating event network-changed:1056879d-4dc9-4cb8-a5a7-372ccbc78813 for instance 327172e2-b2a2-479d-89f8-1810071e75ab on hv-cinder-83602 Aug 18 12:23:11.503225 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-3da33f3a-fe87-4732-b55c-ed147abe0d2e req-e920265e-0d12-45c7-b2c4-43a095f84491 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065926 Aug 18 12:23:11.503932 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 182/360] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:23:12.499493 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-294c6145-569f-4687-b536-7c1783d03fa3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:12.500107 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-294c6145-569f-4687-b536-7c1783d03fa3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:12.507085 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-294c6145-569f-4687-b536-7c1783d03fa3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:12.524765 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-294c6145-569f-4687-b536-7c1783d03fa3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:12.524765 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-294c6145-569f-4687-b536-7c1783d03fa3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:12.524765 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-294c6145-569f-4687-b536-7c1783d03fa3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:12.524765 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-294c6145-569f-4687-b536-7c1783d03fa3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:12.525298 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-294c6145-569f-4687-b536-7c1783d03fa3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:12.661074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-294c6145-569f-4687-b536-7c1783d03fa3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:12.669007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-294c6145-569f-4687-b536-7c1783d03fa3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.173450 Aug 18 12:23:12.670116 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 179/361] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:12 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:13.707463 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-328a8c51-f30b-418a-a2e7-4ea2f4fd643e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:13.708348 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-328a8c51-f30b-418a-a2e7-4ea2f4fd643e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:13.716530 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-328a8c51-f30b-418a-a2e7-4ea2f4fd643e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:13.717411 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-328a8c51-f30b-418a-a2e7-4ea2f4fd643e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:13.718018 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-328a8c51-f30b-418a-a2e7-4ea2f4fd643e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:13.718893 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-328a8c51-f30b-418a-a2e7-4ea2f4fd643e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:13.719564 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-328a8c51-f30b-418a-a2e7-4ea2f4fd643e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:13.720354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-328a8c51-f30b-418a-a2e7-4ea2f4fd643e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:13.863583 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-328a8c51-f30b-418a-a2e7-4ea2f4fd643e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:13.871745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-328a8c51-f30b-418a-a2e7-4ea2f4fd643e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.184205 Aug 18 12:23:13.872323 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 183/362] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:13 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:14.893652 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2c38e465-27a4-4b4b-9ece-5deb59e8aa0b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:14.894381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2c38e465-27a4-4b4b-9ece-5deb59e8aa0b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:14.901531 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2c38e465-27a4-4b4b-9ece-5deb59e8aa0b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:14.902070 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2c38e465-27a4-4b4b-9ece-5deb59e8aa0b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:14.902512 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2c38e465-27a4-4b4b-9ece-5deb59e8aa0b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:14.903219 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2c38e465-27a4-4b4b-9ece-5deb59e8aa0b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:14.904506 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2c38e465-27a4-4b4b-9ece-5deb59e8aa0b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:14.904710 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2c38e465-27a4-4b4b-9ece-5deb59e8aa0b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:15.071077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2c38e465-27a4-4b4b-9ece-5deb59e8aa0b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:15.079933 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2c38e465-27a4-4b4b-9ece-5deb59e8aa0b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.190180 Aug 18 12:23:15.091500 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 180/363] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:14 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:16.101986 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-09d52c75-9eab-4d59-a7f9-3e74c6f31fc7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:16.103494 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-09d52c75-9eab-4d59-a7f9-3e74c6f31fc7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:16.110111 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09d52c75-9eab-4d59-a7f9-3e74c6f31fc7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:16.110587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09d52c75-9eab-4d59-a7f9-3e74c6f31fc7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:16.111027 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09d52c75-9eab-4d59-a7f9-3e74c6f31fc7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:16.111725 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09d52c75-9eab-4d59-a7f9-3e74c6f31fc7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:16.112306 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09d52c75-9eab-4d59-a7f9-3e74c6f31fc7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:16.112729 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-09d52c75-9eab-4d59-a7f9-3e74c6f31fc7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:16.142572 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:16.264130 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-09d52c75-9eab-4d59-a7f9-3e74c6f31fc7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:16.272644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-09d52c75-9eab-4d59-a7f9-3e74c6f31fc7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.174852 Aug 18 12:23:16.273225 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 184/364] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:16 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:17.297500 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c4ad31de-8040-4367-b68a-63d0d05148b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:17.298828 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c4ad31de-8040-4367-b68a-63d0d05148b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:17.301530 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=6 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:17.310287 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c4ad31de-8040-4367-b68a-63d0d05148b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:17.310786 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c4ad31de-8040-4367-b68a-63d0d05148b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:17.311231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c4ad31de-8040-4367-b68a-63d0d05148b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:17.311970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c4ad31de-8040-4367-b68a-63d0d05148b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:17.312425 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c4ad31de-8040-4367-b68a-63d0d05148b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:17.312853 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c4ad31de-8040-4367-b68a-63d0d05148b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:17.473206 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c4ad31de-8040-4367-b68a-63d0d05148b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:17.480751 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c4ad31de-8040-4367-b68a-63d0d05148b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.187934 Aug 18 12:23:17.481370 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 181/365] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:17 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:18.023653 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-20291b99-6f04-4c96-bd53-af3c190c4e47 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bec5d9d-404a-4b86-968f-6a27253e912a", "device": "/dev/sdb"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:18.027599 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-20291b99-6f04-4c96-bd53-af3c190c4e47 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:18.041845 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=8 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:18.049879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20291b99-6f04-4c96-bd53-af3c190c4e47 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:18.050629 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20291b99-6f04-4c96-bd53-af3c190c4e47 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:18.067700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20291b99-6f04-4c96-bd53-af3c190c4e47 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:18.067700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20291b99-6f04-4c96-bd53-af3c190c4e47 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:18.067700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20291b99-6f04-4c96-bd53-af3c190c4e47 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:18.067700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20291b99-6f04-4c96-bd53-af3c190c4e47 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:18.513710 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a95f3041-f754-4849-91d0-3fc0f7611ebd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:18.514307 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a95f3041-f754-4849-91d0-3fc0f7611ebd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:18.527893 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a95f3041-f754-4849-91d0-3fc0f7611ebd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:18.528418 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a95f3041-f754-4849-91d0-3fc0f7611ebd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:18.528854 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a95f3041-f754-4849-91d0-3fc0f7611ebd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:18.529567 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a95f3041-f754-4849-91d0-3fc0f7611ebd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:18.530025 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a95f3041-f754-4849-91d0-3fc0f7611ebd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:18.530451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a95f3041-f754-4849-91d0-3fc0f7611ebd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:18.680820 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a95f3041-f754-4849-91d0-3fc0f7611ebd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:18.690425 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a95f3041-f754-4849-91d0-3fc0f7611ebd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.182558 Aug 18 12:23:18.691013 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 182/366] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:18 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:19.713292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-96318287-72c4-4b94-bac9-84f3bfae0afa tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:19.714793 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-96318287-72c4-4b94-bac9-84f3bfae0afa tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:19.734737 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96318287-72c4-4b94-bac9-84f3bfae0afa tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:19.735722 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96318287-72c4-4b94-bac9-84f3bfae0afa tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:19.736704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96318287-72c4-4b94-bac9-84f3bfae0afa tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:19.737647 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96318287-72c4-4b94-bac9-84f3bfae0afa tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:19.738295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96318287-72c4-4b94-bac9-84f3bfae0afa tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:19.738917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96318287-72c4-4b94-bac9-84f3bfae0afa tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:19.891761 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-96318287-72c4-4b94-bac9-84f3bfae0afa tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:19.900736 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-96318287-72c4-4b94-bac9-84f3bfae0afa tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.190975 Aug 18 12:23:19.900736 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 183/367] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:19 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:20.920791 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4c1f8a05-fa39-4023-aedd-182bdc65a719 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:20.921515 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4c1f8a05-fa39-4023-aedd-182bdc65a719 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:20.927831 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c1f8a05-fa39-4023-aedd-182bdc65a719 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:20.928303 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c1f8a05-fa39-4023-aedd-182bdc65a719 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:20.931551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c1f8a05-fa39-4023-aedd-182bdc65a719 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:20.931551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c1f8a05-fa39-4023-aedd-182bdc65a719 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:20.931551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c1f8a05-fa39-4023-aedd-182bdc65a719 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:20.931551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c1f8a05-fa39-4023-aedd-182bdc65a719 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:21.065958 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4c1f8a05-fa39-4023-aedd-182bdc65a719 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:21.073446 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4c1f8a05-fa39-4023-aedd-182bdc65a719 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.156939 Aug 18 12:23:21.073998 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 184/368] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:20 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:22.094204 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c9f5e9f2-9d53-4b07-a6ae-8f3f5ec79ba3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:22.094920 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c9f5e9f2-9d53-4b07-a6ae-8f3f5ec79ba3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:22.102905 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c9f5e9f2-9d53-4b07-a6ae-8f3f5ec79ba3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:22.110825 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c9f5e9f2-9d53-4b07-a6ae-8f3f5ec79ba3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:22.110825 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c9f5e9f2-9d53-4b07-a6ae-8f3f5ec79ba3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:22.110825 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c9f5e9f2-9d53-4b07-a6ae-8f3f5ec79ba3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:22.110825 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c9f5e9f2-9d53-4b07-a6ae-8f3f5ec79ba3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:22.111188 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c9f5e9f2-9d53-4b07-a6ae-8f3f5ec79ba3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:22.322997 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c9f5e9f2-9d53-4b07-a6ae-8f3f5ec79ba3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:22.331574 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c9f5e9f2-9d53-4b07-a6ae-8f3f5ec79ba3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.241210 Aug 18 12:23:22.332160 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 185/369] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:22 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:22.497618 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-20291b99-6f04-4c96-bd53-af3c190c4e47 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "POST /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.478532 Aug 18 12:23:22.503710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 185/370] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:23:18 2022] POST /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9/os-volume_attachments => generated 194 bytes in 4480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:23.353026 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c985c7b6-d215-4fff-8f0d-37dad918582f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:23.353635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c985c7b6-d215-4fff-8f0d-37dad918582f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:23.360641 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c985c7b6-d215-4fff-8f0d-37dad918582f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:23.361122 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c985c7b6-d215-4fff-8f0d-37dad918582f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:23.361553 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c985c7b6-d215-4fff-8f0d-37dad918582f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:23.362236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c985c7b6-d215-4fff-8f0d-37dad918582f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:23.362686 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c985c7b6-d215-4fff-8f0d-37dad918582f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:23.363107 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c985c7b6-d215-4fff-8f0d-37dad918582f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:23.494149 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c985c7b6-d215-4fff-8f0d-37dad918582f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:23.502015 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c985c7b6-d215-4fff-8f0d-37dad918582f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.152813 Aug 18 12:23:23.502587 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 186/371] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:23 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:24.523077 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ca5c8564-e4ba-43ce-952d-04896a31246b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:24.523788 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ca5c8564-e4ba-43ce-952d-04896a31246b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:24.530535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ca5c8564-e4ba-43ce-952d-04896a31246b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:24.530944 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ca5c8564-e4ba-43ce-952d-04896a31246b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:24.531364 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ca5c8564-e4ba-43ce-952d-04896a31246b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:24.532056 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ca5c8564-e4ba-43ce-952d-04896a31246b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:24.532495 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ca5c8564-e4ba-43ce-952d-04896a31246b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:24.532907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ca5c8564-e4ba-43ce-952d-04896a31246b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:24.536938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:24.676180 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ca5c8564-e4ba-43ce-952d-04896a31246b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:24.683987 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ca5c8564-e4ba-43ce-952d-04896a31246b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.165519 Aug 18 12:23:24.695823 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 186/372] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:24 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:25.706222 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-7ac48aa5-3c3e-42f1-b064-f62ac89f757f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:25.706833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-7ac48aa5-3c3e-42f1-b064-f62ac89f757f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:25.713023 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7ac48aa5-3c3e-42f1-b064-f62ac89f757f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:25.713545 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7ac48aa5-3c3e-42f1-b064-f62ac89f757f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:25.720793 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7ac48aa5-3c3e-42f1-b064-f62ac89f757f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:25.720793 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7ac48aa5-3c3e-42f1-b064-f62ac89f757f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:25.720793 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7ac48aa5-3c3e-42f1-b064-f62ac89f757f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:25.720793 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7ac48aa5-3c3e-42f1-b064-f62ac89f757f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:25.852180 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-7ac48aa5-3c3e-42f1-b064-f62ac89f757f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:25.860395 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-7ac48aa5-3c3e-42f1-b064-f62ac89f757f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.158051 Aug 18 12:23:25.860957 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 187/373] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:25 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:26.518739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-fbbf9c1e-b7d9-420d-87f3-90d06f76d783 req-9157ced9-2fa2-4cbe-9b8b-6f36df9c2fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327172e2-b2a2-479d-89f8-1810071e75ab", "name": "network-vif-plugged", "status": "completed", "tag": "1056879d-4dc9-4cb8-a5a7-372ccbc78813"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:26.529674 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-fbbf9c1e-b7d9-420d-87f3-90d06f76d783 req-9157ced9-2fa2-4cbe-9b8b-6f36df9c2fa1 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:26.530149 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-fbbf9c1e-b7d9-420d-87f3-90d06f76d783 req-9157ced9-2fa2-4cbe-9b8b-6f36df9c2fa1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:26.530572 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-fbbf9c1e-b7d9-420d-87f3-90d06f76d783 req-9157ced9-2fa2-4cbe-9b8b-6f36df9c2fa1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:26.541434 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-fbbf9c1e-b7d9-420d-87f3-90d06f76d783 req-9157ced9-2fa2-4cbe-9b8b-6f36df9c2fa1 service nova] Creating event network-vif-plugged:1056879d-4dc9-4cb8-a5a7-372ccbc78813 for instance 327172e2-b2a2-479d-89f8-1810071e75ab on hv-cinder-83602 Aug 18 12:23:26.546132 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-fbbf9c1e-b7d9-420d-87f3-90d06f76d783 req-9157ced9-2fa2-4cbe-9b8b-6f36df9c2fa1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032024 Aug 18 12:23:26.546707 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 187/374] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:26.880761 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-799b83c0-ba3d-4d45-a6d1-cadfb2440f5f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:26.881371 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-799b83c0-ba3d-4d45-a6d1-cadfb2440f5f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:26.887869 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-799b83c0-ba3d-4d45-a6d1-cadfb2440f5f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:26.888266 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-799b83c0-ba3d-4d45-a6d1-cadfb2440f5f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:26.888732 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-799b83c0-ba3d-4d45-a6d1-cadfb2440f5f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:26.891267 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-799b83c0-ba3d-4d45-a6d1-cadfb2440f5f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:26.892180 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-799b83c0-ba3d-4d45-a6d1-cadfb2440f5f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:26.892619 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-799b83c0-ba3d-4d45-a6d1-cadfb2440f5f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:27.073398 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-799b83c0-ba3d-4d45-a6d1-cadfb2440f5f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:27.081013 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-799b83c0-ba3d-4d45-a6d1-cadfb2440f5f tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.204067 Aug 18 12:23:27.081567 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 188/375] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:26 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:28.102326 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f17f1a41-dc47-411c-9c2e-1a50938c1eb9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:28.103186 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f17f1a41-dc47-411c-9c2e-1a50938c1eb9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:28.111529 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f17f1a41-dc47-411c-9c2e-1a50938c1eb9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:28.112041 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f17f1a41-dc47-411c-9c2e-1a50938c1eb9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:28.112522 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f17f1a41-dc47-411c-9c2e-1a50938c1eb9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:28.113571 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f17f1a41-dc47-411c-9c2e-1a50938c1eb9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:28.114577 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f17f1a41-dc47-411c-9c2e-1a50938c1eb9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:28.114577 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f17f1a41-dc47-411c-9c2e-1a50938c1eb9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:28.299154 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f17f1a41-dc47-411c-9c2e-1a50938c1eb9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:28.307100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f17f1a41-dc47-411c-9c2e-1a50938c1eb9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1358 microversion: 2.1 time: 0.209309 Aug 18 12:23:28.308029 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 188/376] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:28 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:29.329581 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2187b064-223e-4c53-82bf-1616e876786c tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:29.330280 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2187b064-223e-4c53-82bf-1616e876786c tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:29.338055 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2187b064-223e-4c53-82bf-1616e876786c tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:29.338815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2187b064-223e-4c53-82bf-1616e876786c tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:29.339298 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2187b064-223e-4c53-82bf-1616e876786c tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:29.340217 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2187b064-223e-4c53-82bf-1616e876786c tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:29.340865 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2187b064-223e-4c53-82bf-1616e876786c tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:29.341351 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2187b064-223e-4c53-82bf-1616e876786c tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:29.588507 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2187b064-223e-4c53-82bf-1616e876786c tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:29.596643 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2187b064-223e-4c53-82bf-1616e876786c tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1548 microversion: 2.1 time: 0.271887 Aug 18 12:23:29.597327 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 189/377] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:29 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1548 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:29.617500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-71d7a683-56f9-4922-a8a0-efb617b60d1b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:29.618108 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-71d7a683-56f9-4922-a8a0-efb617b60d1b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:29.625112 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-71d7a683-56f9-4922-a8a0-efb617b60d1b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:29.625540 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-71d7a683-56f9-4922-a8a0-efb617b60d1b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:29.625977 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-71d7a683-56f9-4922-a8a0-efb617b60d1b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:29.626669 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-71d7a683-56f9-4922-a8a0-efb617b60d1b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:29.627118 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-71d7a683-56f9-4922-a8a0-efb617b60d1b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:29.627638 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-71d7a683-56f9-4922-a8a0-efb617b60d1b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:29.789908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-71d7a683-56f9-4922-a8a0-efb617b60d1b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:29.798242 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-71d7a683-56f9-4922-a8a0-efb617b60d1b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1548 microversion: 2.1 time: 0.184785 Aug 18 12:23:29.799022 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 189/378] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:29 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:29.879285 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-996c2c41-af4c-446d-ac80-8456d12b1938 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:29.884005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-996c2c41-af4c-446d-ac80-8456d12b1938 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:29.884808 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-996c2c41-af4c-446d-ac80-8456d12b1938 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Searching by: {'deleted': False, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd'} {{(pid=121244) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 12:23:29.892236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-996c2c41-af4c-446d-ac80-8456d12b1938 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:29.892709 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-996c2c41-af4c-446d-ac80-8456d12b1938 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:29.893211 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-996c2c41-af4c-446d-ac80-8456d12b1938 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:29.893852 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-996c2c41-af4c-446d-ac80-8456d12b1938 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:29.894295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-996c2c41-af4c-446d-ac80-8456d12b1938 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:29.894710 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-996c2c41-af4c-446d-ac80-8456d12b1938 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:29.986721 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.multi_cell_list [None req-996c2c41-af4c-446d-ac80-8456d12b1938 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121244) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 12:23:30.088990 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-996c2c41-af4c-446d-ac80-8456d12b1938 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213440 Aug 18 12:23:30.089585 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 190/379] 10.222.0.98 () {58 vars in 1125 bytes} [Thu Aug 18 12:23:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:30.100988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f95b1ac0-173b-40ec-a641-650366555c42 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:30.101603 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f95b1ac0-173b-40ec-a641-650366555c42 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:30.108620 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f95b1ac0-173b-40ec-a641-650366555c42 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:30.109131 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f95b1ac0-173b-40ec-a641-650366555c42 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:30.109586 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f95b1ac0-173b-40ec-a641-650366555c42 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:30.110299 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f95b1ac0-173b-40ec-a641-650366555c42 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:30.110776 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f95b1ac0-173b-40ec-a641-650366555c42 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:30.111198 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f95b1ac0-173b-40ec-a641-650366555c42 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:30.248478 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f95b1ac0-173b-40ec-a641-650366555c42 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:30.256301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f95b1ac0-173b-40ec-a641-650366555c42 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1548 microversion: 2.1 time: 0.159156 Aug 18 12:23:30.256876 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 190/380] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:30 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:32.141979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d20365d4-96b3-465d-beb8-ef32a0f0dd18 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ab1abe6-9528-413f-ab81-039a920343d3"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:32.144436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d20365d4-96b3-465d-beb8-ef32a0f0dd18 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:32.150954 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d20365d4-96b3-465d-beb8-ef32a0f0dd18 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:32.151447 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d20365d4-96b3-465d-beb8-ef32a0f0dd18 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:32.151895 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d20365d4-96b3-465d-beb8-ef32a0f0dd18 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:32.152594 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d20365d4-96b3-465d-beb8-ef32a0f0dd18 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:32.153125 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d20365d4-96b3-465d-beb8-ef32a0f0dd18 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:32.153551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d20365d4-96b3-465d-beb8-ef32a0f0dd18 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:32.954290 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d20365d4-96b3-465d-beb8-ef32a0f0dd18 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "POST /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816774 Aug 18 12:23:32.954909 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 191/381] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:23:32 2022] POST /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:45.823839 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2dbf1777-45cb-41f6-ab95-2ed5cf41fead tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:45.824454 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-2dbf1777-45cb-41f6-ab95-2ed5cf41fead tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:45.828565 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=24 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:45.829229 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=25 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:45.832714 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2dbf1777-45cb-41f6-ab95-2ed5cf41fead tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:45.833204 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2dbf1777-45cb-41f6-ab95-2ed5cf41fead tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:45.833637 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2dbf1777-45cb-41f6-ab95-2ed5cf41fead tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:45.837983 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2dbf1777-45cb-41f6-ab95-2ed5cf41fead tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:45.837983 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2dbf1777-45cb-41f6-ab95-2ed5cf41fead tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:45.837983 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2dbf1777-45cb-41f6-ab95-2ed5cf41fead tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:45.971025 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2dbf1777-45cb-41f6-ab95-2ed5cf41fead tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:45.979013 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2dbf1777-45cb-41f6-ab95-2ed5cf41fead tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1594 microversion: 2.1 time: 0.159149 Aug 18 12:23:45.979606 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 191/382] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:45 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:48.867372 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-59a445c0-314d-4d71-bc5f-531dfe2ae750 req-5ea1f688-e94c-449f-8040-63bd252a3548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327172e2-b2a2-479d-89f8-1810071e75ab", "tag": "1056879d-4dc9-4cb8-a5a7-372ccbc78813"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:48.873736 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:48.874691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:48.875502 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:48.881917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-59a445c0-314d-4d71-bc5f-531dfe2ae750 req-5ea1f688-e94c-449f-8040-63bd252a3548 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:48.887565 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-59a445c0-314d-4d71-bc5f-531dfe2ae750 req-5ea1f688-e94c-449f-8040-63bd252a3548 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:48.887565 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-59a445c0-314d-4d71-bc5f-531dfe2ae750 req-5ea1f688-e94c-449f-8040-63bd252a3548 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:48.895697 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-59a445c0-314d-4d71-bc5f-531dfe2ae750 req-5ea1f688-e94c-449f-8040-63bd252a3548 service nova] Creating event network-changed:1056879d-4dc9-4cb8-a5a7-372ccbc78813 for instance 327172e2-b2a2-479d-89f8-1810071e75ab on hv-cinder-83602 Aug 18 12:23:48.900827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-59a445c0-314d-4d71-bc5f-531dfe2ae750 req-5ea1f688-e94c-449f-8040-63bd252a3548 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041831 Aug 18 12:23:48.901625 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 192/383] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:50.566287 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e58c50a6-0849-4f60-a891-08e866e95283 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:50.566894 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e58c50a6-0849-4f60-a891-08e866e95283 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:50.573655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e58c50a6-0849-4f60-a891-08e866e95283 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:50.573954 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e58c50a6-0849-4f60-a891-08e866e95283 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:50.574382 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e58c50a6-0849-4f60-a891-08e866e95283 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:50.575126 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e58c50a6-0849-4f60-a891-08e866e95283 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:50.575611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e58c50a6-0849-4f60-a891-08e866e95283 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:50.576034 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e58c50a6-0849-4f60-a891-08e866e95283 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:50.702089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-e58c50a6-0849-4f60-a891-08e866e95283 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lazy-loading 'services' on Instance uuid a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:23:50.941677 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e58c50a6-0849-4f60-a891-08e866e95283 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9/os-volume_attachments/6bec5d9d-404a-4b86-968f-6a27253e912a" status: 202 len: 0 microversion: 2.1 time: 0.379411 Aug 18 12:23:50.942228 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 192/384] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:23:50 2022] DELETE /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9/os-volume_attachments/6bec5d9d-404a-4b86-968f-6a27253e912a => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:23:51.446560 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-882acebc-1fb4-40c5-b664-6913bd484c67 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-524478662"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:51.447177 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-882acebc-1fb4-40c5-b664-6913bd484c67 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:51.455591 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-882acebc-1fb4-40c5-b664-6913bd484c67 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:51.456073 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-882acebc-1fb4-40c5-b664-6913bd484c67 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:51.456509 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-882acebc-1fb4-40c5-b664-6913bd484c67 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:51.457193 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-882acebc-1fb4-40c5-b664-6913bd484c67 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:51.457645 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-882acebc-1fb4-40c5-b664-6913bd484c67 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:51.458068 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-882acebc-1fb4-40c5-b664-6913bd484c67 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:51.602899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.network.security_group_api [None req-882acebc-1fb4-40c5-b664-6913bd484c67 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Adding security group e52b3afa-dbd7-4010-9cc9-589944e68595 to port 1056879d-4dc9-4cb8-a5a7-372ccbc78813 Aug 18 12:23:52.021629 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-882acebc-1fb4-40c5-b664-6913bd484c67 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "POST /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/action" status: 202 len: 0 microversion: 2.1 time: 0.580206 Aug 18 12:23:52.028056 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 193/385] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:23:51 2022] POST /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:23:52.030450 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-3191a4fb-7db3-43ac-a24e-49ef7e94f3a3 req-a8e81c02-48e4-4983-95ed-a90cb995a6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327172e2-b2a2-479d-89f8-1810071e75ab", "tag": "1056879d-4dc9-4cb8-a5a7-372ccbc78813"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:52.036271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-52e05961-04ff-45e9-907d-af8cc6975bd8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:52.041734 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-52e05961-04ff-45e9-907d-af8cc6975bd8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:52.047113 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-3191a4fb-7db3-43ac-a24e-49ef7e94f3a3 req-a8e81c02-48e4-4983-95ed-a90cb995a6e3 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:52.047937 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-3191a4fb-7db3-43ac-a24e-49ef7e94f3a3 req-a8e81c02-48e4-4983-95ed-a90cb995a6e3 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:52.048594 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-3191a4fb-7db3-43ac-a24e-49ef7e94f3a3 req-a8e81c02-48e4-4983-95ed-a90cb995a6e3 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:52.058567 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52e05961-04ff-45e9-907d-af8cc6975bd8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:52.059350 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52e05961-04ff-45e9-907d-af8cc6975bd8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:52.059943 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52e05961-04ff-45e9-907d-af8cc6975bd8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:52.061574 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-3191a4fb-7db3-43ac-a24e-49ef7e94f3a3 req-a8e81c02-48e4-4983-95ed-a90cb995a6e3 service nova] Creating event network-changed:1056879d-4dc9-4cb8-a5a7-372ccbc78813 for instance 327172e2-b2a2-479d-89f8-1810071e75ab on hv-cinder-83602 Aug 18 12:23:52.062455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52e05961-04ff-45e9-907d-af8cc6975bd8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:52.062941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52e05961-04ff-45e9-907d-af8cc6975bd8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:52.063378 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52e05961-04ff-45e9-907d-af8cc6975bd8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:52.067982 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-3191a4fb-7db3-43ac-a24e-49ef7e94f3a3 req-a8e81c02-48e4-4983-95ed-a90cb995a6e3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042098 Aug 18 12:23:52.074775 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 193/386] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:52.105644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-109ea2f0-59e8-4b07-a40c-017cea00a48c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:52.107401 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-109ea2f0-59e8-4b07-a40c-017cea00a48c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:52.116098 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-109ea2f0-59e8-4b07-a40c-017cea00a48c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:52.116600 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-109ea2f0-59e8-4b07-a40c-017cea00a48c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:52.117037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-109ea2f0-59e8-4b07-a40c-017cea00a48c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:52.118471 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-109ea2f0-59e8-4b07-a40c-017cea00a48c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:52.118921 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-109ea2f0-59e8-4b07-a40c-017cea00a48c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:52.119354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-109ea2f0-59e8-4b07-a40c-017cea00a48c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:52.146961 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-109ea2f0-59e8-4b07-a40c-017cea00a48c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:23:52.166691 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:23:52.166951 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Thu Aug 18 12:23:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 (ip 10.222.0.98) !!! Aug 18 12:23:52.349195 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-52e05961-04ff-45e9-907d-af8cc6975bd8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:52.358067 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-52e05961-04ff-45e9-907d-af8cc6975bd8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1759 microversion: 2.1 time: 0.325446 Aug 18 12:23:52.376622 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 194/387] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:52 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1759 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:52.533023 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-109ea2f0-59e8-4b07-a40c-017cea00a48c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 204 len: 0 microversion: 2.1 time: 0.437296 Aug 18 12:23:52.534399 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 194/388] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:23:52 2022] DELETE /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:23:52.542683 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b91a9791-6467-4eb5-a05d-561ed878d5c7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:52.543391 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b91a9791-6467-4eb5-a05d-561ed878d5c7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:52.550525 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b91a9791-6467-4eb5-a05d-561ed878d5c7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:52.551178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b91a9791-6467-4eb5-a05d-561ed878d5c7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:52.551654 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b91a9791-6467-4eb5-a05d-561ed878d5c7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:52.554608 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b91a9791-6467-4eb5-a05d-561ed878d5c7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:52.555204 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b91a9791-6467-4eb5-a05d-561ed878d5c7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:52.556223 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b91a9791-6467-4eb5-a05d-561ed878d5c7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:52.686252 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b91a9791-6467-4eb5-a05d-561ed878d5c7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:52.693978 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b91a9791-6467-4eb5-a05d-561ed878d5c7 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1513 microversion: 2.1 time: 0.155245 Aug 18 12:23:52.694552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 195/389] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:52 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:53.715306 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cbc477e9-35a4-4c9d-a2eb-79bff000450d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:53.716014 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-cbc477e9-35a4-4c9d-a2eb-79bff000450d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:53.723692 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbc477e9-35a4-4c9d-a2eb-79bff000450d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:53.724167 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbc477e9-35a4-4c9d-a2eb-79bff000450d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:53.724594 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbc477e9-35a4-4c9d-a2eb-79bff000450d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:53.725323 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbc477e9-35a4-4c9d-a2eb-79bff000450d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:53.725715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbc477e9-35a4-4c9d-a2eb-79bff000450d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:53.726128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbc477e9-35a4-4c9d-a2eb-79bff000450d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:53.856205 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cbc477e9-35a4-4c9d-a2eb-79bff000450d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:53.863652 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cbc477e9-35a4-4c9d-a2eb-79bff000450d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1513 microversion: 2.1 time: 0.152529 Aug 18 12:23:53.864212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 195/390] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:53 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:54.204367 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-27a2da5b-c98e-4d69-8b19-58a04d7ef2dd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:54.204929 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-27a2da5b-c98e-4d69-8b19-58a04d7ef2dd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:54.211268 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27a2da5b-c98e-4d69-8b19-58a04d7ef2dd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:54.211794 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27a2da5b-c98e-4d69-8b19-58a04d7ef2dd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:54.212232 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27a2da5b-c98e-4d69-8b19-58a04d7ef2dd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:54.212930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27a2da5b-c98e-4d69-8b19-58a04d7ef2dd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:54.213385 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27a2da5b-c98e-4d69-8b19-58a04d7ef2dd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:54.213854 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27a2da5b-c98e-4d69-8b19-58a04d7ef2dd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:54.337503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-27a2da5b-c98e-4d69-8b19-58a04d7ef2dd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lazy-loading 'services' on Instance uuid 316b26d0-6178-4b02-8207-e910af024af2 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:23:54.633736 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-27a2da5b-c98e-4d69-8b19-58a04d7ef2dd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "DELETE /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/os-volume_attachments/f8fa5481-6dbe-459a-b2ae-999553900193" status: 202 len: 0 microversion: 2.1 time: 0.433780 Aug 18 12:23:54.634339 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 196/391] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:23:54 2022] DELETE /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/os-volume_attachments/f8fa5481-6dbe-459a-b2ae-999553900193 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:23:54.884145 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-717575a6-1626-4712-b2fe-508e40cc5ade tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:54.884752 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-717575a6-1626-4712-b2fe-508e40cc5ade tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:54.891371 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717575a6-1626-4712-b2fe-508e40cc5ade tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:54.891901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717575a6-1626-4712-b2fe-508e40cc5ade tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:54.892332 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717575a6-1626-4712-b2fe-508e40cc5ade tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:54.893081 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717575a6-1626-4712-b2fe-508e40cc5ade tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:54.893681 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717575a6-1626-4712-b2fe-508e40cc5ade tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:54.893930 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717575a6-1626-4712-b2fe-508e40cc5ade tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:55.055623 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-717575a6-1626-4712-b2fe-508e40cc5ade tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:55.063230 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-717575a6-1626-4712-b2fe-508e40cc5ade tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1513 microversion: 2.1 time: 0.183097 Aug 18 12:23:55.063824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 196/392] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:54 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:55.208876 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-30a96219-9506-4908-87fb-47738a016d1c req-71cd0a74-7976-4e85-88ab-3af870d93bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2758c03-8b2c-4e3a-aed6-b96d385eb0c9", "name": "network-vif-deleted", "tag": "dad22071-2507-4821-a285-b550d9182dc3"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:55.222313 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-30a96219-9506-4908-87fb-47738a016d1c req-71cd0a74-7976-4e85-88ab-3af870d93bcd service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:55.222794 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-30a96219-9506-4908-87fb-47738a016d1c req-71cd0a74-7976-4e85-88ab-3af870d93bcd service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:55.223223 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-30a96219-9506-4908-87fb-47738a016d1c req-71cd0a74-7976-4e85-88ab-3af870d93bcd service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:55.233697 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-30a96219-9506-4908-87fb-47738a016d1c req-71cd0a74-7976-4e85-88ab-3af870d93bcd service nova] Creating event network-vif-deleted:dad22071-2507-4821-a285-b550d9182dc3 for instance a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 on hv-cinder-83602 Aug 18 12:23:55.239127 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-30a96219-9506-4908-87fb-47738a016d1c req-71cd0a74-7976-4e85-88ab-3af870d93bcd service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034127 Aug 18 12:23:55.239999 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 197/393] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:55.753380 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5a2855e6-76ce-46e6-8aac-f32793a1b8e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:55.759368 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5a2855e6-76ce-46e6-8aac-f32793a1b8e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:55.759882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5a2855e6-76ce-46e6-8aac-f32793a1b8e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:55.760317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5a2855e6-76ce-46e6-8aac-f32793a1b8e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:55.782225 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5a2855e6-76ce-46e6-8aac-f32793a1b8e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Going to try to stop instance {{(pid=121245) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 12:23:56.020904 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5a2855e6-76ce-46e6-8aac-f32793a1b8e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "POST /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/action" status: 202 len: 0 microversion: 2.1 time: 0.271718 Aug 18 12:23:56.021586 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 197/394] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:23:55 2022] POST /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:23:56.031088 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4085ca8a-c1bb-4a5a-8500-664d5d94e9d6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:56.031865 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4085ca8a-c1bb-4a5a-8500-664d5d94e9d6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:56.038669 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4085ca8a-c1bb-4a5a-8500-664d5d94e9d6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:56.039154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4085ca8a-c1bb-4a5a-8500-664d5d94e9d6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:56.039620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4085ca8a-c1bb-4a5a-8500-664d5d94e9d6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:56.040314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4085ca8a-c1bb-4a5a-8500-664d5d94e9d6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:56.040763 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4085ca8a-c1bb-4a5a-8500-664d5d94e9d6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:56.041183 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4085ca8a-c1bb-4a5a-8500-664d5d94e9d6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:56.084867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:56.085559 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:56.091877 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:56.092360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:56.092793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:56.093525 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:56.094051 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:56.094472 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:56.129215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:56.129630 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:56.130053 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:56.130505 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lazy-loading 'fault' on Instance uuid a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:23:56.180320 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:56.182198 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4085ca8a-c1bb-4a5a-8500-664d5d94e9d6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:56.192891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4085ca8a-c1bb-4a5a-8500-664d5d94e9d6 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.164902 Aug 18 12:23:56.193479 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 198/395] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:56 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:56.194284 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7bb7aa9c-b6f2-45aa-b53e-95a6bd66675c tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 200 len: 1308 microversion: 2.1 time: 0.113729 Aug 18 12:23:56.195068 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 198/396] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:56 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:57.215592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:57.216194 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e0f316f8-878a-4cb0-bb2f-571cdf675f79 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:57.216575 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: a2758c03-8b2c-4e3a-aed6-b96d385eb0c9] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:57.216681 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e0f316f8-878a-4cb0-bb2f-571cdf675f79 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:57.223383 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:57.223558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e0f316f8-878a-4cb0-bb2f-571cdf675f79 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:57.223887 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e0f316f8-878a-4cb0-bb2f-571cdf675f79 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:57.223997 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:57.224319 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e0f316f8-878a-4cb0-bb2f-571cdf675f79 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:57.224431 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:57.225011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e0f316f8-878a-4cb0-bb2f-571cdf675f79 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:57.225111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:57.225476 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e0f316f8-878a-4cb0-bb2f-571cdf675f79 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:57.225585 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:57.225875 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e0f316f8-878a-4cb0-bb2f-571cdf675f79 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:57.225982 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:57.240528 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] HTTP exception thrown: Instance a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 could not be found. Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Request method failure captured: Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 HTTP/1.1 Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i79m9Mgi_G4FtuzYW5aOivnzs2drFhqG6q49TtV8VvRrIbjK2eLbo5MhgxRAKrfI2GR-LXIq4B8LuWJ9y_afc1ChbjtPG2GffO634495UKTqfh7Chdx1uKFPxODqmkWZSLwYwilUyjzmrXIZaPAvZFC5IbWXTDMPALDWG-r3HQaNyg Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: c01ab18435804769bb4ae0bf86d4d99d Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2115860944 Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:23:57.242178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c01ab18435804769bb4ae0bf86d4d99d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c01ab18435804769bb4ae0bf86d4d99d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c01ab18435804769bb4ae0bf86d4d99d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c01ab18435804769bb4ae0bf86d4d99d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-VolumesSnapshotTestJSON-2115860944 Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: c01ab18435804769bb4ae0bf86d4d99d Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2115860944 Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-VolumesSnapshotTestJSON-2115860944-project Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: e6b767c363bb4a6fa3530f6a677e09f2 Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-VolumesSnapshotTestJSON-2115860944-project Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 could not be found. Aug 18 12:23:57.243775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': 'a2758c03-8b2c-4e3a-aed6-b96d385eb0c9'} Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 could not be found. Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:23:57.244723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 could not be found. Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 could not be found. Aug 18 12:23:57.245939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:23:57.247080 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Returning 404 to user: Instance a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:23:57.247080 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-464150c9-119d-4f9f-9b20-d0292e8d2fba tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9" status: 404 len: 111 microversion: 2.1 time: 0.031825 Aug 18 12:23:57.247080 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 199/397] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:57 2022] GET /compute/v2.1/servers/a2758c03-8b2c-4e3a-aed6-b96d385eb0c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:23:57.361322 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e0f316f8-878a-4cb0-bb2f-571cdf675f79 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:57.369179 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e0f316f8-878a-4cb0-bb2f-571cdf675f79 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.157426 Aug 18 12:23:57.369730 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 199/398] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:57 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:58.390493 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e636baa6-5ad0-42a8-b4fc-b90c36e97c31 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:58.391105 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e636baa6-5ad0-42a8-b4fc-b90c36e97c31 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:58.398135 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e636baa6-5ad0-42a8-b4fc-b90c36e97c31 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:58.398634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e636baa6-5ad0-42a8-b4fc-b90c36e97c31 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:58.399064 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e636baa6-5ad0-42a8-b4fc-b90c36e97c31 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:58.399788 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e636baa6-5ad0-42a8-b4fc-b90c36e97c31 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:58.400245 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e636baa6-5ad0-42a8-b4fc-b90c36e97c31 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:58.400664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e636baa6-5ad0-42a8-b4fc-b90c36e97c31 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:58.529109 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e636baa6-5ad0-42a8-b4fc-b90c36e97c31 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:58.536728 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e636baa6-5ad0-42a8-b4fc-b90c36e97c31 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.150081 Aug 18 12:23:58.537284 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 200/399] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:58 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:59.352468 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7c201ef6-d78f-46ea-8048-1c8df892efbd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:59.353038 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7c201ef6-d78f-46ea-8048-1c8df892efbd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:59.359406 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7c201ef6-d78f-46ea-8048-1c8df892efbd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:59.359915 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7c201ef6-d78f-46ea-8048-1c8df892efbd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:59.360993 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7c201ef6-d78f-46ea-8048-1c8df892efbd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:59.361687 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7c201ef6-d78f-46ea-8048-1c8df892efbd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:59.362140 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7c201ef6-d78f-46ea-8048-1c8df892efbd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:59.362563 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7c201ef6-d78f-46ea-8048-1c8df892efbd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:59.387853 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7c201ef6-d78f-46ea-8048-1c8df892efbd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/ips" status: 200 len: 152 microversion: 2.20 time: 0.038722 Aug 18 12:23:59.388439 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 200/400] 10.222.0.98 () {60 vars in 1289 bytes} [Thu Aug 18 12:23:59 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:23:59.558382 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-9be4130e-9ef0-489f-9391-62da5d509a51 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:59.559070 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-9be4130e-9ef0-489f-9391-62da5d509a51 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:59.566291 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9be4130e-9ef0-489f-9391-62da5d509a51 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:59.566776 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9be4130e-9ef0-489f-9391-62da5d509a51 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:59.567212 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9be4130e-9ef0-489f-9391-62da5d509a51 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:59.567944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9be4130e-9ef0-489f-9391-62da5d509a51 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:59.568396 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9be4130e-9ef0-489f-9391-62da5d509a51 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:59.568820 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9be4130e-9ef0-489f-9391-62da5d509a51 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:59.710753 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-9be4130e-9ef0-489f-9391-62da5d509a51 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:59.718819 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-9be4130e-9ef0-489f-9391-62da5d509a51 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.164280 Aug 18 12:23:59.719378 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 201/401] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:59 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:00.741127 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-40536894-8b73-441e-8f95-557f13aa35cd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:00.741733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-40536894-8b73-441e-8f95-557f13aa35cd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:00.748303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-40536894-8b73-441e-8f95-557f13aa35cd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:00.748780 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-40536894-8b73-441e-8f95-557f13aa35cd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:00.749214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-40536894-8b73-441e-8f95-557f13aa35cd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:00.749904 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-40536894-8b73-441e-8f95-557f13aa35cd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:00.750370 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-40536894-8b73-441e-8f95-557f13aa35cd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:00.750771 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-40536894-8b73-441e-8f95-557f13aa35cd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:00.885131 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-40536894-8b73-441e-8f95-557f13aa35cd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:00.893429 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-40536894-8b73-441e-8f95-557f13aa35cd tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.156228 Aug 18 12:24:00.894989 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 201/402] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:00 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:01.916498 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d5a85c2a-9d13-4e35-a84a-d8d3a6a6ac80 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:01.917103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d5a85c2a-9d13-4e35-a84a-d8d3a6a6ac80 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:01.923684 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5a85c2a-9d13-4e35-a84a-d8d3a6a6ac80 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:01.924163 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5a85c2a-9d13-4e35-a84a-d8d3a6a6ac80 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:01.924652 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5a85c2a-9d13-4e35-a84a-d8d3a6a6ac80 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:01.925272 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5a85c2a-9d13-4e35-a84a-d8d3a6a6ac80 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:01.925898 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5a85c2a-9d13-4e35-a84a-d8d3a6a6ac80 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:01.926320 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d5a85c2a-9d13-4e35-a84a-d8d3a6a6ac80 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:02.058184 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3836ddcd-ae54-4667-88f4-11d80a736bbb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:02.058907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3836ddcd-ae54-4667-88f4-11d80a736bbb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:02.061255 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d5a85c2a-9d13-4e35-a84a-d8d3a6a6ac80 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:02.066178 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3836ddcd-ae54-4667-88f4-11d80a736bbb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:02.066891 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3836ddcd-ae54-4667-88f4-11d80a736bbb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:02.067324 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3836ddcd-ae54-4667-88f4-11d80a736bbb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:02.068218 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3836ddcd-ae54-4667-88f4-11d80a736bbb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:02.068938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3836ddcd-ae54-4667-88f4-11d80a736bbb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:02.069371 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3836ddcd-ae54-4667-88f4-11d80a736bbb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:02.069956 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d5a85c2a-9d13-4e35-a84a-d8d3a6a6ac80 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.157299 Aug 18 12:24:02.070524 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 202/403] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:01 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:02.093651 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-3836ddcd-ae54-4667-88f4-11d80a736bbb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lazy-loading 'flavor' on Instance uuid 9c4dfc92-fb5b-46f3-a14a-992de65d7adb {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:24:02.379329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:02.640533 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3836ddcd-ae54-4667-88f4-11d80a736bbb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "POST /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/action" status: 202 len: 0 microversion: 2.20 time: 0.586180 Aug 18 12:24:02.641122 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 202/404] 10.222.0.98 () {62 vars in 1319 bytes} [Thu Aug 18 12:24:02 2022] POST /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:24:02.649437 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:02.650186 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:02.656524 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:02.657507 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:02.657933 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:02.658643 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:02.659085 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:02.659528 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:02.790438 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:02.798282 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:02.799817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:02.800967 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6b218827-fc70-4cf7-ba58-7fee4e60287f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.155449 Aug 18 12:24:02.801531 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 203/405] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:02 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:03.095626 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b5a231d3-e9a8-4461-9554-e7269f893849 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:03.096315 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b5a231d3-e9a8-4461-9554-e7269f893849 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:03.103173 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5a231d3-e9a8-4461-9554-e7269f893849 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:03.103672 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5a231d3-e9a8-4461-9554-e7269f893849 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:03.104101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5a231d3-e9a8-4461-9554-e7269f893849 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:03.104779 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5a231d3-e9a8-4461-9554-e7269f893849 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:03.105218 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5a231d3-e9a8-4461-9554-e7269f893849 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:03.105631 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5a231d3-e9a8-4461-9554-e7269f893849 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:03.239727 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b5a231d3-e9a8-4461-9554-e7269f893849 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:03.247480 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b5a231d3-e9a8-4461-9554-e7269f893849 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.157039 Aug 18 12:24:03.248043 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 203/406] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:03 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:03.824169 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:03.824776 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:03.831180 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:03.831698 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:03.832137 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:03.832829 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:03.833282 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:03.833703 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:03.967624 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:03.976293 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:03.977879 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:03.979083 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ca29a607-c8b1-46bf-ace3-0b1fe250fe95 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.158715 Aug 18 12:24:03.979550 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 204/407] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:03 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:04.269387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3ee8e13f-0857-42ac-80c2-2f03f1cc14ac tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:04.269996 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3ee8e13f-0857-42ac-80c2-2f03f1cc14ac tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:04.276474 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ee8e13f-0857-42ac-80c2-2f03f1cc14ac tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:04.276950 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ee8e13f-0857-42ac-80c2-2f03f1cc14ac tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:04.277385 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ee8e13f-0857-42ac-80c2-2f03f1cc14ac tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:04.278162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ee8e13f-0857-42ac-80c2-2f03f1cc14ac tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:04.278618 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ee8e13f-0857-42ac-80c2-2f03f1cc14ac tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:04.279035 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ee8e13f-0857-42ac-80c2-2f03f1cc14ac tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:04.283863 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d580608f-c0ac-4721-8442-15fab5d1ad58 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b505ffc5-b0df-4bba-a2c6-12559c7026a7"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:04.286238 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d580608f-c0ac-4721-8442-15fab5d1ad58 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:04.292117 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d580608f-c0ac-4721-8442-15fab5d1ad58 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:04.292599 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d580608f-c0ac-4721-8442-15fab5d1ad58 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:04.293033 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d580608f-c0ac-4721-8442-15fab5d1ad58 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:04.293719 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d580608f-c0ac-4721-8442-15fab5d1ad58 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:04.294167 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d580608f-c0ac-4721-8442-15fab5d1ad58 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:04.294592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d580608f-c0ac-4721-8442-15fab5d1ad58 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:04.420801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3ee8e13f-0857-42ac-80c2-2f03f1cc14ac tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:04.428421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3ee8e13f-0857-42ac-80c2-2f03f1cc14ac tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.163429 Aug 18 12:24:04.428986 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 204/408] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:04 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:05.003040 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:05.003739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:05.009918 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:05.010399 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:05.010829 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:05.011538 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:05.011983 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:05.012396 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:05.146566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:05.154757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:05.156293 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:05.157468 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0d422902-0e3f-4bfe-8d7a-15e6afb62768 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.158988 Aug 18 12:24:05.158025 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 205/409] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:04 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:05.448903 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c300947b-7edc-4f7e-92d1-9fd2746efa1c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:05.449550 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c300947b-7edc-4f7e-92d1-9fd2746efa1c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:05.455903 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c300947b-7edc-4f7e-92d1-9fd2746efa1c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:05.456381 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c300947b-7edc-4f7e-92d1-9fd2746efa1c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:05.456841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c300947b-7edc-4f7e-92d1-9fd2746efa1c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:05.457527 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c300947b-7edc-4f7e-92d1-9fd2746efa1c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:05.457976 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c300947b-7edc-4f7e-92d1-9fd2746efa1c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:05.458397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c300947b-7edc-4f7e-92d1-9fd2746efa1c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:05.589933 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c300947b-7edc-4f7e-92d1-9fd2746efa1c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:05.597920 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c300947b-7edc-4f7e-92d1-9fd2746efa1c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.152978 Aug 18 12:24:05.598481 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 206/410] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:05 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:06.180645 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:06.181274 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:06.187554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:06.188593 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:06.189022 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:06.189707 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:06.190146 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:06.190566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:06.319858 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:06.327823 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:06.329967 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:06.331106 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ec42b34f-b86c-409a-b84b-373e7ab6d409 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.154403 Aug 18 12:24:06.331695 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 207/411] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:06 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:06.620272 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0aab64d9-07bf-4d07-b929-cd86480e600c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:06.620923 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0aab64d9-07bf-4d07-b929-cd86480e600c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:06.627582 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0aab64d9-07bf-4d07-b929-cd86480e600c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:06.628056 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0aab64d9-07bf-4d07-b929-cd86480e600c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:06.628483 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0aab64d9-07bf-4d07-b929-cd86480e600c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:06.629172 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0aab64d9-07bf-4d07-b929-cd86480e600c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:06.629610 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0aab64d9-07bf-4d07-b929-cd86480e600c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:06.630023 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0aab64d9-07bf-4d07-b929-cd86480e600c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:06.763517 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0aab64d9-07bf-4d07-b929-cd86480e600c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:06.771760 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0aab64d9-07bf-4d07-b929-cd86480e600c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.155293 Aug 18 12:24:06.772333 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 208/412] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:06 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:06.893893 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d580608f-c0ac-4721-8442-15fab5d1ad58 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "POST /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.614507 Aug 18 12:24:06.894520 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 205/413] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:24:04 2022] POST /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments => generated 194 bytes in 2616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:24:07.354515 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:07.355176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:07.361425 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:07.361904 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:07.363449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:07.363449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:07.363911 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:07.364293 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:07.496069 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:07.504068 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:07.505570 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:07.506757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-827c4fbf-d22e-4b63-af82-a1689f86caa2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.156353 Aug 18 12:24:07.507325 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 209/414] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:07 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:07.708878 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1106960736", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "networks": [{"uuid": "5e073d15-f9de-4f1c-bdfd-768829fe9e53"}]}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:07.761426 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] validate_networks() for [('5e073d15-f9de-4f1c-bdfd-768829fe9e53', None, None, None, None, None)] {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:24:07.792291 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0efaa5b6-c31e-4d5e-93b7-0cc5fe17608b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:07.792893 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0efaa5b6-c31e-4d5e-93b7-0cc5fe17608b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:07.799257 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0efaa5b6-c31e-4d5e-93b7-0cc5fe17608b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:07.799769 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0efaa5b6-c31e-4d5e-93b7-0cc5fe17608b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:07.800196 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0efaa5b6-c31e-4d5e-93b7-0cc5fe17608b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:07.800872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0efaa5b6-c31e-4d5e-93b7-0cc5fe17608b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:07.801314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0efaa5b6-c31e-4d5e-93b7-0cc5fe17608b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:07.801724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0efaa5b6-c31e-4d5e-93b7-0cc5fe17608b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:07.934709 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0efaa5b6-c31e-4d5e-93b7-0cc5fe17608b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:07.943276 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0efaa5b6-c31e-4d5e-93b7-0cc5fe17608b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.154715 Aug 18 12:24:07.944590 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 210/415] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:07 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:08.354149 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:24:08.354649 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:24:08.355022 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:24:08.355439 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:24:08.355927 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:24:08.365134 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:08.365608 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:08.366041 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:08.366799 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:08.367250 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:08.367700 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:08.386225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Getting quotas for project c01ab18435804769bb4ae0bf86d4d99d. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:24:08.390278 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Getting quotas for user e6b767c363bb4a6fa3530f6a677e09f2 and project c01ab18435804769bb4ae0bf86d4d99d. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:24:08.402150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:24:08.404550 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:24:08.527693 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b6004f82-09bb-4306-aa84-f44b6b1598fa tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823706 Aug 18 12:24:08.528625 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 206/416] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:24:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:24:08.529962 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:08.530714 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:08.537227 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:08.537713 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:08.538151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:08.538847 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:08.539300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:08.539745 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d98ef11f-cacb-4368-9311-222e7c9f090d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:08.540125 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:08.540361 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d98ef11f-cacb-4368-9311-222e7c9f090d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:08.611604 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d98ef11f-cacb-4368-9311-222e7c9f090d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:08.614000 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d98ef11f-cacb-4368-9311-222e7c9f090d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1219 microversion: 2.1 time: 0.078130 Aug 18 12:24:08.618258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 207/417] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:08 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:08.686229 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:08.695320 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:08.696873 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:08.698112 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2effcc72-5e73-49a1-a10b-c4c333ff5e9e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.172291 Aug 18 12:24:08.698663 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 211/418] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:08 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:08.964594 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ec3b913a-0e25-4684-8b4f-dd273083c782 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:08.965343 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ec3b913a-0e25-4684-8b4f-dd273083c782 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:08.972148 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ec3b913a-0e25-4684-8b4f-dd273083c782 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:08.972632 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ec3b913a-0e25-4684-8b4f-dd273083c782 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:08.973080 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ec3b913a-0e25-4684-8b4f-dd273083c782 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:08.973765 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ec3b913a-0e25-4684-8b4f-dd273083c782 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:08.974229 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ec3b913a-0e25-4684-8b4f-dd273083c782 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:08.974657 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ec3b913a-0e25-4684-8b4f-dd273083c782 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:09.112419 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ec3b913a-0e25-4684-8b4f-dd273083c782 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:09.121270 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ec3b913a-0e25-4684-8b4f-dd273083c782 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.160516 Aug 18 12:24:09.121923 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 208/419] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:08 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:09.635015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8add81c2-23fe-4838-b385-40f8f00c76f5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:09.635649 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8add81c2-23fe-4838-b385-40f8f00c76f5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:09.642065 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8add81c2-23fe-4838-b385-40f8f00c76f5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:09.642661 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8add81c2-23fe-4838-b385-40f8f00c76f5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:09.643092 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8add81c2-23fe-4838-b385-40f8f00c76f5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:09.643811 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8add81c2-23fe-4838-b385-40f8f00c76f5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:09.644257 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8add81c2-23fe-4838-b385-40f8f00c76f5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:09.644675 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8add81c2-23fe-4838-b385-40f8f00c76f5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:09.709741 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8add81c2-23fe-4838-b385-40f8f00c76f5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:09.718116 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8add81c2-23fe-4838-b385-40f8f00c76f5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1223 microversion: 2.1 time: 0.086768 Aug 18 12:24:09.718975 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 212/420] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:09 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:09.721118 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:09.721744 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:09.729891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:09.730730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:09.731180 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:09.732132 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:09.732947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:09.733503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:09.872100 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:09.882082 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:09.884299 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:09.893388 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-75136829-0b0f-4a65-aec5-1dbacf2c02a2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.168737 Aug 18 12:24:09.893388 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 209/421] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:09 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:10.142627 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b9004351-f7b5-42bc-bc3e-e0951625ac86 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:10.143237 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b9004351-f7b5-42bc-bc3e-e0951625ac86 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:10.149320 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b9004351-f7b5-42bc-bc3e-e0951625ac86 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:10.149742 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b9004351-f7b5-42bc-bc3e-e0951625ac86 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:10.150170 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b9004351-f7b5-42bc-bc3e-e0951625ac86 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:10.150861 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b9004351-f7b5-42bc-bc3e-e0951625ac86 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:10.151308 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b9004351-f7b5-42bc-bc3e-e0951625ac86 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:10.151759 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b9004351-f7b5-42bc-bc3e-e0951625ac86 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:10.282497 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b9004351-f7b5-42bc-bc3e-e0951625ac86 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:10.290134 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b9004351-f7b5-42bc-bc3e-e0951625ac86 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.151944 Aug 18 12:24:10.290696 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 213/422] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:10 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:10.741549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-955e4bec-245b-4488-9834-a3b768f20444 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:10.742233 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-955e4bec-245b-4488-9834-a3b768f20444 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:10.749584 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-955e4bec-245b-4488-9834-a3b768f20444 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:10.750080 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-955e4bec-245b-4488-9834-a3b768f20444 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:10.750515 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-955e4bec-245b-4488-9834-a3b768f20444 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:10.751394 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-955e4bec-245b-4488-9834-a3b768f20444 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:10.752117 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-955e4bec-245b-4488-9834-a3b768f20444 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:10.752697 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-955e4bec-245b-4488-9834-a3b768f20444 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:10.771768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:10.828429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-955e4bec-245b-4488-9834-a3b768f20444 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:10.836437 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-955e4bec-245b-4488-9834-a3b768f20444 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1289 microversion: 2.1 time: 0.099375 Aug 18 12:24:10.837034 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 210/423] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:10 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:10.909275 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:10.910871 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:10.916365 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:10.916853 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:10.917279 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:10.917966 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:10.918409 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:10.918825 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:11.054598 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:11.062700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:11.064250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:11.065495 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-113b9c91-03cd-4642-8d23-ec95c5a2f9b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.160743 Aug 18 12:24:11.066051 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 214/424] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:10 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:11.312086 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8d2715b6-1bfb-4fce-bc44-f99d9264a586 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:11.312719 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8d2715b6-1bfb-4fce-bc44-f99d9264a586 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:11.319911 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8d2715b6-1bfb-4fce-bc44-f99d9264a586 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:11.320397 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8d2715b6-1bfb-4fce-bc44-f99d9264a586 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:11.320837 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8d2715b6-1bfb-4fce-bc44-f99d9264a586 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:11.321517 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8d2715b6-1bfb-4fce-bc44-f99d9264a586 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:11.321963 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8d2715b6-1bfb-4fce-bc44-f99d9264a586 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:11.322375 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8d2715b6-1bfb-4fce-bc44-f99d9264a586 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:11.581329 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8d2715b6-1bfb-4fce-bc44-f99d9264a586 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:11.589142 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8d2715b6-1bfb-4fce-bc44-f99d9264a586 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.281055 Aug 18 12:24:11.591240 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 211/425] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:11 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:11.857088 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e8944f8f-1c6a-4f7e-ab65-b7be857b3d64 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:11.858430 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e8944f8f-1c6a-4f7e-ab65-b7be857b3d64 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:11.864534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8944f8f-1c6a-4f7e-ab65-b7be857b3d64 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:11.865015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8944f8f-1c6a-4f7e-ab65-b7be857b3d64 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:11.865442 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8944f8f-1c6a-4f7e-ab65-b7be857b3d64 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:11.866130 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8944f8f-1c6a-4f7e-ab65-b7be857b3d64 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:11.866620 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8944f8f-1c6a-4f7e-ab65-b7be857b3d64 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:11.866977 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e8944f8f-1c6a-4f7e-ab65-b7be857b3d64 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:12.005155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e8944f8f-1c6a-4f7e-ab65-b7be857b3d64 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:12.012606 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e8944f8f-1c6a-4f7e-ab65-b7be857b3d64 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1319 microversion: 2.1 time: 0.159382 Aug 18 12:24:12.013163 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 215/426] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:11 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:12.046476 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-74cf2e0e-cc46-4314-8fce-6e7992dbb71a req-94cba444-1650-45eb-8d7f-3cb3ef70e9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37989372-191d-4fe3-be7a-6339e6b4d03e", "tag": "fc84efa4-7f15-453b-ba54-640983f1ed4e"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:12.056897 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-74cf2e0e-cc46-4314-8fce-6e7992dbb71a req-94cba444-1650-45eb-8d7f-3cb3ef70e9e0 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:12.057302 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-74cf2e0e-cc46-4314-8fce-6e7992dbb71a req-94cba444-1650-45eb-8d7f-3cb3ef70e9e0 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:12.057737 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-74cf2e0e-cc46-4314-8fce-6e7992dbb71a req-94cba444-1650-45eb-8d7f-3cb3ef70e9e0 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:12.069431 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-74cf2e0e-cc46-4314-8fce-6e7992dbb71a req-94cba444-1650-45eb-8d7f-3cb3ef70e9e0 service nova] Creating event network-changed:fc84efa4-7f15-453b-ba54-640983f1ed4e for instance 37989372-191d-4fe3-be7a-6339e6b4d03e on hv-cinder-83602 Aug 18 12:24:12.074383 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-74cf2e0e-cc46-4314-8fce-6e7992dbb71a req-94cba444-1650-45eb-8d7f-3cb3ef70e9e0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031873 Aug 18 12:24:12.074985 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 212/427] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:24:12.088483 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:12.089279 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:12.096006 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:12.096677 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:12.097117 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:12.097807 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:12.098414 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:12.099010 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:12.238300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:12.258781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:12.258781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:12.258781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-bb26960f-6b29-4911-a577-839d9af704b3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.165516 Aug 18 12:24:12.261256 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 216/428] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:12 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:12.611772 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ea05b376-9277-46f1-a36f-5d4746c32fc2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:12.612390 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ea05b376-9277-46f1-a36f-5d4746c32fc2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:12.618971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ea05b376-9277-46f1-a36f-5d4746c32fc2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:12.619825 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ea05b376-9277-46f1-a36f-5d4746c32fc2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:12.619951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ea05b376-9277-46f1-a36f-5d4746c32fc2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:12.620643 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ea05b376-9277-46f1-a36f-5d4746c32fc2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:12.621098 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ea05b376-9277-46f1-a36f-5d4746c32fc2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:12.621525 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ea05b376-9277-46f1-a36f-5d4746c32fc2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:12.762817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ea05b376-9277-46f1-a36f-5d4746c32fc2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:12.770611 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ea05b376-9277-46f1-a36f-5d4746c32fc2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.163881 Aug 18 12:24:12.771185 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 213/429] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:12 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:13.033898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a5a2d4a1-3b62-4116-b299-a278c453c951 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:13.034511 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a5a2d4a1-3b62-4116-b299-a278c453c951 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:13.040944 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a2d4a1-3b62-4116-b299-a278c453c951 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:13.041425 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a2d4a1-3b62-4116-b299-a278c453c951 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:13.041861 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a2d4a1-3b62-4116-b299-a278c453c951 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:13.042550 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a2d4a1-3b62-4116-b299-a278c453c951 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:13.043004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a2d4a1-3b62-4116-b299-a278c453c951 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:13.043443 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a2d4a1-3b62-4116-b299-a278c453c951 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:13.191206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a5a2d4a1-3b62-4116-b299-a278c453c951 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:13.199208 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a5a2d4a1-3b62-4116-b299-a278c453c951 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1319 microversion: 2.1 time: 0.169522 Aug 18 12:24:13.199848 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 217/430] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:13 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:13.282431 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:13.283119 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:13.289681 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:13.290053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:13.290489 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:13.291208 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:13.291685 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:13.292106 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:13.425069 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:13.433008 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:13.434526 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:13.435753 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-dff6f7a3-53c5-4b06-904c-22743ceab342 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.157304 Aug 18 12:24:13.436303 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 214/431] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:13 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:13.791265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2da2d964-63ff-4cb7-8553-ab5e7e8004af tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:13.791888 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-2da2d964-63ff-4cb7-8553-ab5e7e8004af tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:13.798471 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2da2d964-63ff-4cb7-8553-ab5e7e8004af tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:13.798945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2da2d964-63ff-4cb7-8553-ab5e7e8004af tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:13.799379 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2da2d964-63ff-4cb7-8553-ab5e7e8004af tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:13.800102 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2da2d964-63ff-4cb7-8553-ab5e7e8004af tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:13.800552 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2da2d964-63ff-4cb7-8553-ab5e7e8004af tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:13.800992 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2da2d964-63ff-4cb7-8553-ab5e7e8004af tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:13.927404 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2da2d964-63ff-4cb7-8553-ab5e7e8004af tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:13.934769 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2da2d964-63ff-4cb7-8553-ab5e7e8004af tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.147353 Aug 18 12:24:13.935319 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 218/432] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:13 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:14.219230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a523a580-9aec-4af8-a654-6d31163199ee tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:14.220503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a523a580-9aec-4af8-a654-6d31163199ee tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:14.226492 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a523a580-9aec-4af8-a654-6d31163199ee tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:14.226981 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a523a580-9aec-4af8-a654-6d31163199ee tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:14.227446 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a523a580-9aec-4af8-a654-6d31163199ee tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:14.228125 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a523a580-9aec-4af8-a654-6d31163199ee tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:14.228580 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a523a580-9aec-4af8-a654-6d31163199ee tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:14.229006 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a523a580-9aec-4af8-a654-6d31163199ee tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:14.362009 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a523a580-9aec-4af8-a654-6d31163199ee tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:14.370272 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a523a580-9aec-4af8-a654-6d31163199ee tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1319 microversion: 2.1 time: 0.154834 Aug 18 12:24:14.370831 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 215/433] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:14 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:14.459704 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:14.460307 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:14.466666 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:14.467169 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:14.467641 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:14.468321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:14.468766 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:14.469185 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:14.487133 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=100 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:14.596459 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:14.605821 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:14.607353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:14.608699 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-02606ed7-2bd1-4e72-86cd-fd57f81440d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.152978 Aug 18 12:24:14.609262 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 219/434] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:14 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:14.956694 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-42cd212b-a1f1-4323-9904-9c2081a1ab3b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:14.958200 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-42cd212b-a1f1-4323-9904-9c2081a1ab3b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:14.968467 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42cd212b-a1f1-4323-9904-9c2081a1ab3b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:14.969387 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42cd212b-a1f1-4323-9904-9c2081a1ab3b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:14.970179 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42cd212b-a1f1-4323-9904-9c2081a1ab3b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:14.981928 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42cd212b-a1f1-4323-9904-9c2081a1ab3b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:14.982440 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42cd212b-a1f1-4323-9904-9c2081a1ab3b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:14.982880 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42cd212b-a1f1-4323-9904-9c2081a1ab3b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:15.114316 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-42cd212b-a1f1-4323-9904-9c2081a1ab3b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:15.121812 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-42cd212b-a1f1-4323-9904-9c2081a1ab3b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.169119 Aug 18 12:24:15.122383 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 216/435] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:14 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:15.390947 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0b352ad6-a10a-4631-b47d-5654c0ade40d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:15.391619 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0b352ad6-a10a-4631-b47d-5654c0ade40d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:15.398294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0b352ad6-a10a-4631-b47d-5654c0ade40d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:15.398776 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0b352ad6-a10a-4631-b47d-5654c0ade40d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:15.399269 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0b352ad6-a10a-4631-b47d-5654c0ade40d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:15.400011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0b352ad6-a10a-4631-b47d-5654c0ade40d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:15.400466 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0b352ad6-a10a-4631-b47d-5654c0ade40d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:15.400883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0b352ad6-a10a-4631-b47d-5654c0ade40d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:15.506653 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ef2157ff-7bf8-467d-8b0a-8b949bdf75cb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:15.509029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ef2157ff-7bf8-467d-8b0a-8b949bdf75cb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:15.515405 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef2157ff-7bf8-467d-8b0a-8b949bdf75cb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:15.515918 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef2157ff-7bf8-467d-8b0a-8b949bdf75cb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:15.518792 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef2157ff-7bf8-467d-8b0a-8b949bdf75cb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:15.518792 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef2157ff-7bf8-467d-8b0a-8b949bdf75cb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:15.518792 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef2157ff-7bf8-467d-8b0a-8b949bdf75cb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:15.518792 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ef2157ff-7bf8-467d-8b0a-8b949bdf75cb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:15.541439 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0b352ad6-a10a-4631-b47d-5654c0ade40d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:15.542321 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-ef2157ff-7bf8-467d-8b0a-8b949bdf75cb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lazy-loading 'flavor' on Instance uuid e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:24:15.549380 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0b352ad6-a10a-4631-b47d-5654c0ade40d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1319 microversion: 2.1 time: 0.162155 Aug 18 12:24:15.549943 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 220/436] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:15 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:15.633111 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:15.633111 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:15.638509 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:15.638985 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:15.639439 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:15.640124 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:15.640574 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:15.640994 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:15.771332 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:15.780064 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:15.781579 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:15.782760 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cb52692b-6cb0-49a8-aff0-bc9b5bf2435c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.154634 Aug 18 12:24:15.783959 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 221/437] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:15 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:15.832771 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ef2157ff-7bf8-467d-8b0a-8b949bdf75cb tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "POST /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/action" status: 200 len: 32 microversion: 2.1 time: 0.329900 Aug 18 12:24:15.833401 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 217/438] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:24:15 2022] POST /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/action => generated 32 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 12:24:15.842832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a060d866-c986-4ade-aeb9-31a19c3c0549 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:15.843460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a060d866-c986-4ade-aeb9-31a19c3c0549 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:15.849567 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a060d866-c986-4ade-aeb9-31a19c3c0549 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:15.850056 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a060d866-c986-4ade-aeb9-31a19c3c0549 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:15.850493 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a060d866-c986-4ade-aeb9-31a19c3c0549 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:15.851189 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a060d866-c986-4ade-aeb9-31a19c3c0549 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:15.851767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a060d866-c986-4ade-aeb9-31a19c3c0549 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:15.852157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a060d866-c986-4ade-aeb9-31a19c3c0549 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:15.986376 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a060d866-c986-4ade-aeb9-31a19c3c0549 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:15.994488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a060d866-c986-4ade-aeb9-31a19c3c0549 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.155448 Aug 18 12:24:15.995048 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 222/439] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:15 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:16.143530 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-16a01435-54a3-418c-9f53-aa104a065b64 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:16.144221 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-16a01435-54a3-418c-9f53-aa104a065b64 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:16.150276 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16a01435-54a3-418c-9f53-aa104a065b64 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:16.150753 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16a01435-54a3-418c-9f53-aa104a065b64 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:16.151187 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16a01435-54a3-418c-9f53-aa104a065b64 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:16.151901 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16a01435-54a3-418c-9f53-aa104a065b64 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:16.152455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16a01435-54a3-418c-9f53-aa104a065b64 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:16.152757 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16a01435-54a3-418c-9f53-aa104a065b64 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:16.345602 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-16a01435-54a3-418c-9f53-aa104a065b64 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:16.353323 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-16a01435-54a3-418c-9f53-aa104a065b64 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1676 microversion: 2.1 time: 0.214674 Aug 18 12:24:16.353886 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 218/440] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:16 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:16.569390 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-93126c73-719f-48b8-94ff-3422afef51e2 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:16.569936 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-93126c73-719f-48b8-94ff-3422afef51e2 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:16.576776 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93126c73-719f-48b8-94ff-3422afef51e2 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:16.577403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93126c73-719f-48b8-94ff-3422afef51e2 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:16.577850 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93126c73-719f-48b8-94ff-3422afef51e2 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:16.578799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93126c73-719f-48b8-94ff-3422afef51e2 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:16.579254 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93126c73-719f-48b8-94ff-3422afef51e2 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:16.579710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93126c73-719f-48b8-94ff-3422afef51e2 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:16.737317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-93126c73-719f-48b8-94ff-3422afef51e2 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:16.745090 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-93126c73-719f-48b8-94ff-3422afef51e2 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1319 microversion: 2.1 time: 0.179813 Aug 18 12:24:16.745654 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 223/441] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:16 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:16.806692 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:16.807295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:16.813819 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:16.814304 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:16.814731 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:16.815434 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:16.815899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:16.816323 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:16.915642 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-80c20974-818f-44ac-9540-6800274d3876 req-bbdd3b77-4707-4afc-9edb-e651da628afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37989372-191d-4fe3-be7a-6339e6b4d03e", "name": "network-vif-plugged", "status": "completed", "tag": "fc84efa4-7f15-453b-ba54-640983f1ed4e"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:16.925158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-80c20974-818f-44ac-9540-6800274d3876 req-bbdd3b77-4707-4afc-9edb-e651da628afb service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:16.925661 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-80c20974-818f-44ac-9540-6800274d3876 req-bbdd3b77-4707-4afc-9edb-e651da628afb service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:16.926083 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-80c20974-818f-44ac-9540-6800274d3876 req-bbdd3b77-4707-4afc-9edb-e651da628afb service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:16.936832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-80c20974-818f-44ac-9540-6800274d3876 req-bbdd3b77-4707-4afc-9edb-e651da628afb service nova] Creating event network-vif-plugged:fc84efa4-7f15-453b-ba54-640983f1ed4e for instance 37989372-191d-4fe3-be7a-6339e6b4d03e on hv-cinder-83602 Aug 18 12:24:16.941800 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-80c20974-818f-44ac-9540-6800274d3876 req-bbdd3b77-4707-4afc-9edb-e651da628afb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030381 Aug 18 12:24:16.942440 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 224/442] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:24:16.952477 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:16.961422 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:16.963022 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:16.964202 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b2e527c6-aec7-4d87-8d73-78670c85a9c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.161959 Aug 18 12:24:16.964753 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 219/443] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:16 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:17.018006 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8ed3eef9-6c90-4ad9-8d0b-29c43d7c20b9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:17.018744 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8ed3eef9-6c90-4ad9-8d0b-29c43d7c20b9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:17.025076 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ed3eef9-6c90-4ad9-8d0b-29c43d7c20b9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:17.025633 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ed3eef9-6c90-4ad9-8d0b-29c43d7c20b9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:17.026072 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ed3eef9-6c90-4ad9-8d0b-29c43d7c20b9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:17.026772 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ed3eef9-6c90-4ad9-8d0b-29c43d7c20b9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:17.027226 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ed3eef9-6c90-4ad9-8d0b-29c43d7c20b9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:17.027677 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ed3eef9-6c90-4ad9-8d0b-29c43d7c20b9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:17.166757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8ed3eef9-6c90-4ad9-8d0b-29c43d7c20b9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:17.174773 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8ed3eef9-6c90-4ad9-8d0b-29c43d7c20b9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.162082 Aug 18 12:24:17.175343 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 225/444] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:17 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:17.375303 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-95f8c4ee-7072-4ce8-8471-cf9f6ba14847 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:17.375915 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-95f8c4ee-7072-4ce8-8471-cf9f6ba14847 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:17.382195 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-95f8c4ee-7072-4ce8-8471-cf9f6ba14847 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:17.382678 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-95f8c4ee-7072-4ce8-8471-cf9f6ba14847 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:17.383114 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-95f8c4ee-7072-4ce8-8471-cf9f6ba14847 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:17.383845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-95f8c4ee-7072-4ce8-8471-cf9f6ba14847 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:17.384299 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-95f8c4ee-7072-4ce8-8471-cf9f6ba14847 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:17.384722 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-95f8c4ee-7072-4ce8-8471-cf9f6ba14847 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:17.524893 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-95f8c4ee-7072-4ce8-8471-cf9f6ba14847 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:17.532390 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-95f8c4ee-7072-4ce8-8471-cf9f6ba14847 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1653 microversion: 2.1 time: 0.160990 Aug 18 12:24:17.532955 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 220/445] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:17 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1653 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:17.553971 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8fa7de1e-bf5c-4123-84b8-9832e0725920 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:17.560032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8fa7de1e-bf5c-4123-84b8-9832e0725920 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:17.560509 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8fa7de1e-bf5c-4123-84b8-9832e0725920 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:17.560940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8fa7de1e-bf5c-4123-84b8-9832e0725920 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:17.584374 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8fa7de1e-bf5c-4123-84b8-9832e0725920 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Going to try to start instance {{(pid=121245) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 18 12:24:17.765795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-981a7e23-3427-40ce-a39d-046ca923ea60 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:17.766448 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-981a7e23-3427-40ce-a39d-046ca923ea60 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:17.773000 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-981a7e23-3427-40ce-a39d-046ca923ea60 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:17.773485 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-981a7e23-3427-40ce-a39d-046ca923ea60 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:17.773635 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8fa7de1e-bf5c-4123-84b8-9832e0725920 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "POST /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/action" status: 202 len: 0 microversion: 2.1 time: 0.223390 Aug 18 12:24:17.773919 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-981a7e23-3427-40ce-a39d-046ca923ea60 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:17.774243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 226/446] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:24:17 2022] POST /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:24:17.774622 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-981a7e23-3427-40ce-a39d-046ca923ea60 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:17.775154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-981a7e23-3427-40ce-a39d-046ca923ea60 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:17.775608 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-981a7e23-3427-40ce-a39d-046ca923ea60 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:17.782880 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d5a796ba-5a59-405d-8847-e8147efc290f tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:17.784150 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d5a796ba-5a59-405d-8847-e8147efc290f tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:17.790368 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d5a796ba-5a59-405d-8847-e8147efc290f tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:17.791874 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d5a796ba-5a59-405d-8847-e8147efc290f tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:17.791874 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d5a796ba-5a59-405d-8847-e8147efc290f tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:17.792066 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d5a796ba-5a59-405d-8847-e8147efc290f tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:17.792477 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d5a796ba-5a59-405d-8847-e8147efc290f tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:17.792900 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d5a796ba-5a59-405d-8847-e8147efc290f tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:17.915470 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-981a7e23-3427-40ce-a39d-046ca923ea60 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:17.923269 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-981a7e23-3427-40ce-a39d-046ca923ea60 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1319 microversion: 2.1 time: 0.161236 Aug 18 12:24:17.931965 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 221/447] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:17 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:17.987295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:17.995954 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:17.995954 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:17.995954 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:17.995954 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:17.996400 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:17.996536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:17.997143 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:18.136407 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:18.145800 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:18.147351 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:18.148804 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3e76444c-0842-4d66-9381-10671c5104d6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.165542 Aug 18 12:24:18.149527 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 222/448] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:17 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:18.161427 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d5a796ba-5a59-405d-8847-e8147efc290f tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:18.168876 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d5a796ba-5a59-405d-8847-e8147efc290f tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1662 microversion: 2.1 time: 0.390489 Aug 18 12:24:18.169435 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 227/449] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:17 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1662 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:18.196225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-73860b60-0408-44fe-a4e7-1a7a19217dc8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:18.196828 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-73860b60-0408-44fe-a4e7-1a7a19217dc8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:18.202740 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-73860b60-0408-44fe-a4e7-1a7a19217dc8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:18.203213 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-73860b60-0408-44fe-a4e7-1a7a19217dc8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:18.203694 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-73860b60-0408-44fe-a4e7-1a7a19217dc8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:18.204377 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-73860b60-0408-44fe-a4e7-1a7a19217dc8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:18.204821 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-73860b60-0408-44fe-a4e7-1a7a19217dc8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:18.205909 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-73860b60-0408-44fe-a4e7-1a7a19217dc8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:18.338100 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-73860b60-0408-44fe-a4e7-1a7a19217dc8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:18.346046 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-73860b60-0408-44fe-a4e7-1a7a19217dc8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.153546 Aug 18 12:24:18.346604 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 223/450] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:18 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:18.944945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6129f90d-e507-4105-8421-6542309a3688 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:18.945710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-6129f90d-e507-4105-8421-6542309a3688 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:18.951949 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6129f90d-e507-4105-8421-6542309a3688 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:18.952447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6129f90d-e507-4105-8421-6542309a3688 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:18.952907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6129f90d-e507-4105-8421-6542309a3688 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:18.953637 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6129f90d-e507-4105-8421-6542309a3688 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:18.954092 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6129f90d-e507-4105-8421-6542309a3688 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:18.954516 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6129f90d-e507-4105-8421-6542309a3688 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:19.103705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-6129f90d-e507-4105-8421-6542309a3688 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:19.111825 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-6129f90d-e507-4105-8421-6542309a3688 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1509 microversion: 2.1 time: 0.170755 Aug 18 12:24:19.114609 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 228/451] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:18 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:19.139883 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ae4afdf7-d7cf-4450-b1e8-24068c049ee5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7168ca65-1dcb-4e82-b859-c2dde42369e9", "device": "/dev/sdb"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:19.142953 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ae4afdf7-d7cf-4450-b1e8-24068c049ee5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:19.145782 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:19.146838 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=8 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:19.152291 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae4afdf7-d7cf-4450-b1e8-24068c049ee5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:19.152891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae4afdf7-d7cf-4450-b1e8-24068c049ee5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:19.153337 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae4afdf7-d7cf-4450-b1e8-24068c049ee5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:19.154040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae4afdf7-d7cf-4450-b1e8-24068c049ee5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:19.154515 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae4afdf7-d7cf-4450-b1e8-24068c049ee5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:19.155159 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae4afdf7-d7cf-4450-b1e8-24068c049ee5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:19.172562 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:19.173154 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:19.181096 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:19.181916 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:19.182591 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:19.183524 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:19.184192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:19.184830 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:19.327449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:19.335736 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:19.337228 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:19.338379 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-64f16a3c-bbe2-491a-9682-371afcf3d9a0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1743 microversion: 2.20 time: 0.170360 Aug 18 12:24:19.338930 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 229/452] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:19 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:19.343530 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1fbbfa3e-7768-4111-bc46-4ac1833ad2a3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:19.344161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1fbbfa3e-7768-4111-bc46-4ac1833ad2a3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:19.350941 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1fbbfa3e-7768-4111-bc46-4ac1833ad2a3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:19.351434 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1fbbfa3e-7768-4111-bc46-4ac1833ad2a3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:19.352043 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1fbbfa3e-7768-4111-bc46-4ac1833ad2a3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:19.352909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1fbbfa3e-7768-4111-bc46-4ac1833ad2a3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:19.353356 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1fbbfa3e-7768-4111-bc46-4ac1833ad2a3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:19.353768 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1fbbfa3e-7768-4111-bc46-4ac1833ad2a3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:19.506615 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1fbbfa3e-7768-4111-bc46-4ac1833ad2a3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:19.514632 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1fbbfa3e-7768-4111-bc46-4ac1833ad2a3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1662 microversion: 2.1 time: 0.174572 Aug 18 12:24:19.515227 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 230/453] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:19 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1662 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:19.519617 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-476fd99c-7314-4c5a-a338-c65a42617f3c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:19.520215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-476fd99c-7314-4c5a-a338-c65a42617f3c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:19.525922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-476fd99c-7314-4c5a-a338-c65a42617f3c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:19.526401 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-476fd99c-7314-4c5a-a338-c65a42617f3c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:19.526840 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-476fd99c-7314-4c5a-a338-c65a42617f3c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:19.527631 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-476fd99c-7314-4c5a-a338-c65a42617f3c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:19.528084 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-476fd99c-7314-4c5a-a338-c65a42617f3c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:19.528503 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-476fd99c-7314-4c5a-a338-c65a42617f3c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:19.660834 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-476fd99c-7314-4c5a-a338-c65a42617f3c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:19.668789 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-476fd99c-7314-4c5a-a338-c65a42617f3c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.152607 Aug 18 12:24:19.669351 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 231/454] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:19 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:19.784508 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:19.991666 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ae4afdf7-d7cf-4450-b1e8-24068c049ee5 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "POST /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857056 Aug 18 12:24:19.992292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 224/455] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:24:19 2022] POST /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:24:20.368738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:20.369294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:20.375983 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:20.376459 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:20.376896 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:20.377583 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:20.378033 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:20.378451 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:20.534692 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:20.539232 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f089a7eb-108c-49a9-8e81-8bb6a87aad99 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:20.539953 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f089a7eb-108c-49a9-8e81-8bb6a87aad99 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:20.543911 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:20.546918 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:20.547045 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f089a7eb-108c-49a9-8e81-8bb6a87aad99 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:20.547148 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-85fd8f25-dca7-4d8f-a3cd-e8abe8fcddb4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1743 microversion: 2.20 time: 0.181855 Aug 18 12:24:20.547242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f089a7eb-108c-49a9-8e81-8bb6a87aad99 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:20.547327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 232/456] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:20 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:20.547442 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f089a7eb-108c-49a9-8e81-8bb6a87aad99 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:20.548064 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f089a7eb-108c-49a9-8e81-8bb6a87aad99 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:20.548519 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f089a7eb-108c-49a9-8e81-8bb6a87aad99 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:20.548925 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f089a7eb-108c-49a9-8e81-8bb6a87aad99 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:20.691124 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c3f7c885-c2a7-4837-9390-eccd0add0f26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:20.691972 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c3f7c885-c2a7-4837-9390-eccd0add0f26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:20.693097 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f089a7eb-108c-49a9-8e81-8bb6a87aad99 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:20.694199 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:20.699783 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f7c885-c2a7-4837-9390-eccd0add0f26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:20.700611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f7c885-c2a7-4837-9390-eccd0add0f26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:20.700772 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f7c885-c2a7-4837-9390-eccd0add0f26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:20.701127 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f089a7eb-108c-49a9-8e81-8bb6a87aad99 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1662 microversion: 2.1 time: 0.169073 Aug 18 12:24:20.701895 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 225/457] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:20 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1662 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:20.702043 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f7c885-c2a7-4837-9390-eccd0add0f26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:20.702481 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f7c885-c2a7-4837-9390-eccd0add0f26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:20.702959 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3f7c885-c2a7-4837-9390-eccd0add0f26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:20.844812 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-7503542e-993b-4156-826b-e91673e5ad81 req-2d9d3b04-c870-4dde-b8ed-b1fa4f30f451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4dfc92-fb5b-46f3-a14a-992de65d7adb", "name": "network-vif-plugged", "status": "completed", "tag": "45eda560-60cf-411c-954a-1838984f4e8f"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:20.855331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-7503542e-993b-4156-826b-e91673e5ad81 req-2d9d3b04-c870-4dde-b8ed-b1fa4f30f451 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:20.855664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-7503542e-993b-4156-826b-e91673e5ad81 req-2d9d3b04-c870-4dde-b8ed-b1fa4f30f451 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:20.856150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-7503542e-993b-4156-826b-e91673e5ad81 req-2d9d3b04-c870-4dde-b8ed-b1fa4f30f451 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:20.858046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c3f7c885-c2a7-4837-9390-eccd0add0f26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:20.868028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-7503542e-993b-4156-826b-e91673e5ad81 req-2d9d3b04-c870-4dde-b8ed-b1fa4f30f451 service nova] Creating event network-vif-plugged:45eda560-60cf-411c-954a-1838984f4e8f for instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb on hv-cinder-83602 Aug 18 12:24:20.870649 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c3f7c885-c2a7-4837-9390-eccd0add0f26 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.184004 Aug 18 12:24:20.873083 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-7503542e-993b-4156-826b-e91673e5ad81 req-2d9d3b04-c870-4dde-b8ed-b1fa4f30f451 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031872 Aug 18 12:24:20.873556 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 233/458] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:20 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:20.873833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 226/459] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:24:21.571022 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:21.571656 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:21.578297 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:21.578792 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:21.579453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:21.580162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:21.580615 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:21.581037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:21.717010 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:21.722977 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a0e9082d-e3e8-4c3f-a6c1-130629b3a759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:21.723711 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a0e9082d-e3e8-4c3f-a6c1-130629b3a759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:21.725335 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:21.725643 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:21.727017 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:21.728480 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-443e9d6f-8413-4e62-ace7-541480791883 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1738 microversion: 2.20 time: 0.161740 Aug 18 12:24:21.743448 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 234/460] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:21 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:21.743640 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0e9082d-e3e8-4c3f-a6c1-130629b3a759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:21.743640 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0e9082d-e3e8-4c3f-a6c1-130629b3a759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:21.743640 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0e9082d-e3e8-4c3f-a6c1-130629b3a759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:21.743640 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0e9082d-e3e8-4c3f-a6c1-130629b3a759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:21.746063 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0e9082d-e3e8-4c3f-a6c1-130629b3a759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:21.746063 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0e9082d-e3e8-4c3f-a6c1-130629b3a759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:21.866291 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a0e9082d-e3e8-4c3f-a6c1-130629b3a759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:21.873804 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a0e9082d-e3e8-4c3f-a6c1-130629b3a759 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1666 microversion: 2.1 time: 0.155406 Aug 18 12:24:21.874376 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 227/461] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:21 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:21.895549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-914bb7ee-2194-4af6-88cf-e60c95f9795b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:21.896444 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-914bb7ee-2194-4af6-88cf-e60c95f9795b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:21.905459 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-914bb7ee-2194-4af6-88cf-e60c95f9795b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:21.906452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-914bb7ee-2194-4af6-88cf-e60c95f9795b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:21.906980 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-914bb7ee-2194-4af6-88cf-e60c95f9795b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:21.908334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-914bb7ee-2194-4af6-88cf-e60c95f9795b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:21.909565 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-914bb7ee-2194-4af6-88cf-e60c95f9795b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:21.910449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-914bb7ee-2194-4af6-88cf-e60c95f9795b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:22.045562 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-914bb7ee-2194-4af6-88cf-e60c95f9795b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:22.048929 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:22.054642 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-914bb7ee-2194-4af6-88cf-e60c95f9795b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.164232 Aug 18 12:24:22.055216 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 235/462] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:21 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:22.755003 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:22.756436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:22.763188 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:22.763707 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:22.764342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:22.765207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:22.765870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:22.766290 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:22.990232 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:22.990232 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:22.990835 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:22.990835 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e82fdd58-fd49-4e5e-88f8-15a0792d6c63 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1738 microversion: 2.20 time: 0.234113 Aug 18 12:24:22.990835 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 228/463] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:22 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:23.078308 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3f79965c-f2f9-4d06-ad36-841e83639b61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:23.078942 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3f79965c-f2f9-4d06-ad36-841e83639b61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:23.086493 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3f79965c-f2f9-4d06-ad36-841e83639b61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:23.086974 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3f79965c-f2f9-4d06-ad36-841e83639b61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:23.087405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3f79965c-f2f9-4d06-ad36-841e83639b61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:23.088404 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3f79965c-f2f9-4d06-ad36-841e83639b61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:23.088856 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3f79965c-f2f9-4d06-ad36-841e83639b61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:23.089271 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3f79965c-f2f9-4d06-ad36-841e83639b61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:23.260508 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3f79965c-f2f9-4d06-ad36-841e83639b61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:23.269333 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3f79965c-f2f9-4d06-ad36-841e83639b61 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.196755 Aug 18 12:24:23.270265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 236/464] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:23 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:24.008382 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:24.009137 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:24.015938 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:24.016415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:24.017195 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:24.018035 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:24.018978 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:24.020319 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:24.171589 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:24.183037 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:24.185631 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:24.188678 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-1c3dfb13-9b20-4032-a00b-968694ddfef0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1738 microversion: 2.20 time: 0.184543 Aug 18 12:24:24.189434 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 229/465] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:24 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:24.291192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-10bab641-28e9-4617-ae52-c7286f8a5e97 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:24.295200 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-10bab641-28e9-4617-ae52-c7286f8a5e97 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:24.302832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-10bab641-28e9-4617-ae52-c7286f8a5e97 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:24.304116 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-10bab641-28e9-4617-ae52-c7286f8a5e97 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:24.305087 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-10bab641-28e9-4617-ae52-c7286f8a5e97 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:24.306241 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-10bab641-28e9-4617-ae52-c7286f8a5e97 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:24.306860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-10bab641-28e9-4617-ae52-c7286f8a5e97 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:24.310007 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-10bab641-28e9-4617-ae52-c7286f8a5e97 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:24.465211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-10bab641-28e9-4617-ae52-c7286f8a5e97 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:24.475260 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-10bab641-28e9-4617-ae52-c7286f8a5e97 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.188949 Aug 18 12:24:24.475861 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 237/466] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:24 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:24.701158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-21de7d4a-6b0c-463e-8350-5d0089171bff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:24.703796 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-21de7d4a-6b0c-463e-8350-5d0089171bff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:24.710576 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21de7d4a-6b0c-463e-8350-5d0089171bff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:24.711065 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21de7d4a-6b0c-463e-8350-5d0089171bff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:24.711552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21de7d4a-6b0c-463e-8350-5d0089171bff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:24.712624 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21de7d4a-6b0c-463e-8350-5d0089171bff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:24.713088 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21de7d4a-6b0c-463e-8350-5d0089171bff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:24.713514 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-21de7d4a-6b0c-463e-8350-5d0089171bff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:25.214257 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:25.214902 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:25.221053 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:25.222192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:25.222610 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:25.223322 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:25.223810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:25.228683 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:25.296344 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-21de7d4a-6b0c-463e-8350-5d0089171bff tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "POST /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/action" status: 202 len: 0 microversion: 2.1 time: 0.598834 Aug 18 12:24:25.302643 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 230/467] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:24:24 2022] POST /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:24:25.314002 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-939e12de-42c8-4594-9613-c1b2f72ab13d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:25.315203 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-939e12de-42c8-4594-9613-c1b2f72ab13d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:25.329967 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-939e12de-42c8-4594-9613-c1b2f72ab13d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:25.330472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-939e12de-42c8-4594-9613-c1b2f72ab13d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:25.331521 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-939e12de-42c8-4594-9613-c1b2f72ab13d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:25.332242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-939e12de-42c8-4594-9613-c1b2f72ab13d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:25.332703 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-939e12de-42c8-4594-9613-c1b2f72ab13d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:25.333128 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-939e12de-42c8-4594-9613-c1b2f72ab13d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:25.391857 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:25.413381 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:25.416794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:25.416794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-aed2398c-f264-40c5-8d15-db46944eb596 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1738 microversion: 2.20 time: 0.206370 Aug 18 12:24:25.419959 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 238/468] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:25 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:25.497462 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8ddd55ed-151f-4f46-8822-0c23b1419b0b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:25.498134 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8ddd55ed-151f-4f46-8822-0c23b1419b0b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:25.507876 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ddd55ed-151f-4f46-8822-0c23b1419b0b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:25.508831 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ddd55ed-151f-4f46-8822-0c23b1419b0b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:25.513135 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ddd55ed-151f-4f46-8822-0c23b1419b0b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:25.514269 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ddd55ed-151f-4f46-8822-0c23b1419b0b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:25.514988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ddd55ed-151f-4f46-8822-0c23b1419b0b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:25.516176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8ddd55ed-151f-4f46-8822-0c23b1419b0b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:25.583370 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-939e12de-42c8-4594-9613-c1b2f72ab13d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:25.597257 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-939e12de-42c8-4594-9613-c1b2f72ab13d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1751 microversion: 2.1 time: 0.290836 Aug 18 12:24:25.607708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 231/469] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:25 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1751 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:25.686107 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8ddd55ed-151f-4f46-8822-0c23b1419b0b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:25.694995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8ddd55ed-151f-4f46-8822-0c23b1419b0b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.201702 Aug 18 12:24:25.705106 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 239/470] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:25 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:26.441076 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:26.441837 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:26.452239 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:26.453043 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:26.453708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:26.455051 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:26.455758 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:26.456583 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:26.619754 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b80d5d4f-d421-4178-988d-62fc8d8dc01b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:26.621159 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b80d5d4f-d421-4178-988d-62fc8d8dc01b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:26.624930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:26.638449 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:26.640430 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b80d5d4f-d421-4178-988d-62fc8d8dc01b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:26.648766 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:26.649550 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b80d5d4f-d421-4178-988d-62fc8d8dc01b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:26.649550 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b80d5d4f-d421-4178-988d-62fc8d8dc01b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:26.649550 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b80d5d4f-d421-4178-988d-62fc8d8dc01b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:26.649550 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b80d5d4f-d421-4178-988d-62fc8d8dc01b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:26.649913 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b80d5d4f-d421-4178-988d-62fc8d8dc01b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:26.651170 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-32e66258-e2ce-4dce-b2a6-b032d4d8266e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1738 microversion: 2.20 time: 0.215528 Aug 18 12:24:26.652303 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 232/471] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:26 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:26.717081 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0f924aef-dc97-4700-8840-596986aa14a5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:26.717878 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0f924aef-dc97-4700-8840-596986aa14a5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:26.724615 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0f924aef-dc97-4700-8840-596986aa14a5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:26.725103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0f924aef-dc97-4700-8840-596986aa14a5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:26.725541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0f924aef-dc97-4700-8840-596986aa14a5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:26.728663 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0f924aef-dc97-4700-8840-596986aa14a5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:26.729146 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0f924aef-dc97-4700-8840-596986aa14a5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:26.729610 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0f924aef-dc97-4700-8840-596986aa14a5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:26.902081 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b80d5d4f-d421-4178-988d-62fc8d8dc01b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:26.913519 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b80d5d4f-d421-4178-988d-62fc8d8dc01b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.297481 Aug 18 12:24:26.928087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0f924aef-dc97-4700-8840-596986aa14a5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:26.928905 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 240/472] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:26 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:26.934883 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0f924aef-dc97-4700-8840-596986aa14a5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.222027 Aug 18 12:24:26.935671 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 233/473] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:26 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:27.686012 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:27.686627 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:27.695017 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:27.695907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:27.696747 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:27.697724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:27.698383 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:27.698882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:27.883344 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:27.899835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:27.901165 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:27.902569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5e476ceb-679a-4143-bb1d-ae6555cd9c80 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1738 microversion: 2.20 time: 0.223531 Aug 18 12:24:27.903140 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 241/474] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:27 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:27.935709 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a40b6ad4-7aa7-49f9-b581-ba3a4826c75b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:27.936458 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a40b6ad4-7aa7-49f9-b581-ba3a4826c75b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:27.944183 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a40b6ad4-7aa7-49f9-b581-ba3a4826c75b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:27.944676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a40b6ad4-7aa7-49f9-b581-ba3a4826c75b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:27.948326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a40b6ad4-7aa7-49f9-b581-ba3a4826c75b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:27.948326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a40b6ad4-7aa7-49f9-b581-ba3a4826c75b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:27.948326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a40b6ad4-7aa7-49f9-b581-ba3a4826c75b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:27.948326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a40b6ad4-7aa7-49f9-b581-ba3a4826c75b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:27.958128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a91a9502-2415-477e-a341-5aac16202aab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:27.959237 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a91a9502-2415-477e-a341-5aac16202aab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:27.966255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a91a9502-2415-477e-a341-5aac16202aab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:27.967308 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a91a9502-2415-477e-a341-5aac16202aab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:27.968304 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a91a9502-2415-477e-a341-5aac16202aab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:27.969504 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a91a9502-2415-477e-a341-5aac16202aab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:27.970032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a91a9502-2415-477e-a341-5aac16202aab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:27.970679 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a91a9502-2415-477e-a341-5aac16202aab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:28.139753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a91a9502-2415-477e-a341-5aac16202aab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:28.148830 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a91a9502-2415-477e-a341-5aac16202aab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.195392 Aug 18 12:24:28.149718 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 242/475] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:27 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:28.422578 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a40b6ad4-7aa7-49f9-b581-ba3a4826c75b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:28.430637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a40b6ad4-7aa7-49f9-b581-ba3a4826c75b tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.498819 Aug 18 12:24:28.431208 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 234/476] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:27 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:28.927779 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:28.929622 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:28.938422 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:28.939696 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:28.940548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:28.941353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:28.941866 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:28.942536 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:29.142305 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:29.152280 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:29.153917 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:29.155067 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b7d7488d-dc61-4598-aa7e-a6334ff5f114 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1738 microversion: 2.20 time: 0.232101 Aug 18 12:24:29.155877 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 243/477] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:28 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:29.171183 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0d85219e-36f1-40bc-89d8-0198ef5f2931 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:29.171969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0d85219e-36f1-40bc-89d8-0198ef5f2931 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:29.179268 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d85219e-36f1-40bc-89d8-0198ef5f2931 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:29.180119 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d85219e-36f1-40bc-89d8-0198ef5f2931 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:29.181281 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d85219e-36f1-40bc-89d8-0198ef5f2931 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:29.182351 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d85219e-36f1-40bc-89d8-0198ef5f2931 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:29.183057 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d85219e-36f1-40bc-89d8-0198ef5f2931 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:29.183607 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0d85219e-36f1-40bc-89d8-0198ef5f2931 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:29.329347 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0d85219e-36f1-40bc-89d8-0198ef5f2931 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:29.341111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0d85219e-36f1-40bc-89d8-0198ef5f2931 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.174167 Aug 18 12:24:29.341989 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 235/478] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:29 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:29.452064 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-12a67c57-f915-4136-8055-d1d1120f4be0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:29.452836 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-12a67c57-f915-4136-8055-d1d1120f4be0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:29.464254 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-12a67c57-f915-4136-8055-d1d1120f4be0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:29.465046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-12a67c57-f915-4136-8055-d1d1120f4be0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:29.465645 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-12a67c57-f915-4136-8055-d1d1120f4be0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:29.466551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-12a67c57-f915-4136-8055-d1d1120f4be0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:29.467166 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-12a67c57-f915-4136-8055-d1d1120f4be0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:29.467777 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-12a67c57-f915-4136-8055-d1d1120f4be0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:29.647940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-12a67c57-f915-4136-8055-d1d1120f4be0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:29.656407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-12a67c57-f915-4136-8055-d1d1120f4be0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.208051 Aug 18 12:24:29.657323 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 244/479] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:29 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:30.183973 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:30.185288 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:30.192038 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:30.192829 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:30.193601 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:30.194542 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:30.195056 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:30.195575 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:30.368259 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:30.373850 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1326da84-7605-4d45-b993-ec75f252fa39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:30.375111 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1326da84-7605-4d45-b993-ec75f252fa39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:30.384173 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:30.386235 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:30.386692 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1326da84-7605-4d45-b993-ec75f252fa39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:30.387227 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1326da84-7605-4d45-b993-ec75f252fa39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:30.387694 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1326da84-7605-4d45-b993-ec75f252fa39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:30.388387 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a32263fe-cba3-434b-b85a-84c08a5f4982 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1738 microversion: 2.20 time: 0.213820 Aug 18 12:24:30.388509 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1326da84-7605-4d45-b993-ec75f252fa39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:30.388853 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1326da84-7605-4d45-b993-ec75f252fa39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:30.389281 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1326da84-7605-4d45-b993-ec75f252fa39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:30.390002 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 236/480] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:30 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:30.554351 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1326da84-7605-4d45-b993-ec75f252fa39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:30.562624 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1326da84-7605-4d45-b993-ec75f252fa39 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.203082 Aug 18 12:24:30.563195 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 245/481] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:30 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:30.680655 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c0f721d3-27fd-4931-b6d6-9f28b5fc2081 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:30.681239 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c0f721d3-27fd-4931-b6d6-9f28b5fc2081 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:30.687358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0f721d3-27fd-4931-b6d6-9f28b5fc2081 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:30.687923 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0f721d3-27fd-4931-b6d6-9f28b5fc2081 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:30.688344 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0f721d3-27fd-4931-b6d6-9f28b5fc2081 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:30.689048 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0f721d3-27fd-4931-b6d6-9f28b5fc2081 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:30.694433 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0f721d3-27fd-4931-b6d6-9f28b5fc2081 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:30.694433 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c0f721d3-27fd-4931-b6d6-9f28b5fc2081 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:30.878000 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c0f721d3-27fd-4931-b6d6-9f28b5fc2081 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:30.887396 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c0f721d3-27fd-4931-b6d6-9f28b5fc2081 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.213411 Aug 18 12:24:30.888341 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 237/482] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:30 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:31.412660 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:31.413333 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:31.420318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:31.420794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:31.421218 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:31.421907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:31.422348 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:31.422765 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:31.576851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:31.583800 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-610a55aa-05b7-4785-b64a-453b7886e76e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:31.584486 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-610a55aa-05b7-4785-b64a-453b7886e76e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:31.585751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:31.587655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:31.588815 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2a85eacf-e80e-40d0-8d64-90824ca8244e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1738 microversion: 2.20 time: 0.180295 Aug 18 12:24:31.589374 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 246/483] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:31 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:31.590863 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-610a55aa-05b7-4785-b64a-453b7886e76e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:31.591346 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-610a55aa-05b7-4785-b64a-453b7886e76e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:31.591849 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-610a55aa-05b7-4785-b64a-453b7886e76e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:31.592542 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-610a55aa-05b7-4785-b64a-453b7886e76e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:31.592992 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-610a55aa-05b7-4785-b64a-453b7886e76e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:31.593609 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-610a55aa-05b7-4785-b64a-453b7886e76e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:31.746737 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-610a55aa-05b7-4785-b64a-453b7886e76e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:31.755727 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-610a55aa-05b7-4785-b64a-453b7886e76e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.176200 Aug 18 12:24:31.756295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 238/484] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:31 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:31.908543 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d545ccb4-f6a7-4c09-8eae-22eeffc958cd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:31.909228 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d545ccb4-f6a7-4c09-8eae-22eeffc958cd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:31.915127 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d545ccb4-f6a7-4c09-8eae-22eeffc958cd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:31.923060 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d545ccb4-f6a7-4c09-8eae-22eeffc958cd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:31.923518 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d545ccb4-f6a7-4c09-8eae-22eeffc958cd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:31.924697 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d545ccb4-f6a7-4c09-8eae-22eeffc958cd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:31.925136 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d545ccb4-f6a7-4c09-8eae-22eeffc958cd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:31.925546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d545ccb4-f6a7-4c09-8eae-22eeffc958cd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:32.083229 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d545ccb4-f6a7-4c09-8eae-22eeffc958cd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:32.091237 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d545ccb4-f6a7-4c09-8eae-22eeffc958cd tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.186441 Aug 18 12:24:32.091832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 247/485] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:31 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:32.612352 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:32.613426 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:32.619988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:32.620684 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:32.621580 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:32.622502 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:32.622964 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:32.623730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:32.760822 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:32.768981 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:32.770495 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:32.771677 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e2a64c0b-178d-4ce9-9305-4aee8350a3f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1738 microversion: 2.20 time: 0.164252 Aug 18 12:24:32.772675 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 239/486] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:32 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:32.777790 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3e1e9c88-51e3-4504-bd57-2b1df2265848 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:32.778522 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3e1e9c88-51e3-4504-bd57-2b1df2265848 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:32.784939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e1e9c88-51e3-4504-bd57-2b1df2265848 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:32.792100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e1e9c88-51e3-4504-bd57-2b1df2265848 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:32.792543 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e1e9c88-51e3-4504-bd57-2b1df2265848 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:32.793234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e1e9c88-51e3-4504-bd57-2b1df2265848 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:32.793690 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e1e9c88-51e3-4504-bd57-2b1df2265848 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:32.794109 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e1e9c88-51e3-4504-bd57-2b1df2265848 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:32.936971 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3e1e9c88-51e3-4504-bd57-2b1df2265848 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:32.947839 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3e1e9c88-51e3-4504-bd57-2b1df2265848 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.173980 Aug 18 12:24:32.948413 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 248/487] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:32 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:33.117075 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2ebf73d1-7737-48fc-86cd-c3a23f93590a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:33.117369 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2ebf73d1-7737-48fc-86cd-c3a23f93590a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:33.124055 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ebf73d1-7737-48fc-86cd-c3a23f93590a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:33.124467 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ebf73d1-7737-48fc-86cd-c3a23f93590a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:33.124899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ebf73d1-7737-48fc-86cd-c3a23f93590a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:33.125616 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ebf73d1-7737-48fc-86cd-c3a23f93590a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:33.126061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ebf73d1-7737-48fc-86cd-c3a23f93590a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:33.126477 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2ebf73d1-7737-48fc-86cd-c3a23f93590a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:33.279998 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2ebf73d1-7737-48fc-86cd-c3a23f93590a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:33.284076 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:33.288779 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2ebf73d1-7737-48fc-86cd-c3a23f93590a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.178716 Aug 18 12:24:33.289338 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 240/488] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:33 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:33.794176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:33.794783 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:33.801341 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:33.801829 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:33.802260 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:33.802952 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:33.803401 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:33.803851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:33.934489 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:33.943047 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:33.944657 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:33.945887 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-57500ad9-9fe2-4831-b2f9-a08ac4cba30e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1738 microversion: 2.20 time: 0.155509 Aug 18 12:24:33.946394 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 249/489] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:33 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:33.968224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ddb9891e-293e-42d5-b12b-1353117ae498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:33.968830 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ddb9891e-293e-42d5-b12b-1353117ae498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:33.975647 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ddb9891e-293e-42d5-b12b-1353117ae498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:33.976122 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ddb9891e-293e-42d5-b12b-1353117ae498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:33.976552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ddb9891e-293e-42d5-b12b-1353117ae498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:33.977243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ddb9891e-293e-42d5-b12b-1353117ae498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:33.977682 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ddb9891e-293e-42d5-b12b-1353117ae498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:33.978100 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ddb9891e-293e-42d5-b12b-1353117ae498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:34.110108 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ddb9891e-293e-42d5-b12b-1353117ae498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:34.118880 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ddb9891e-293e-42d5-b12b-1353117ae498 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.154781 Aug 18 12:24:34.119479 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 241/490] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:33 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:34.318623 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e1350c12-d5ca-4306-a87e-1bfc78454a2e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:34.319318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e1350c12-d5ca-4306-a87e-1bfc78454a2e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:34.325840 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1350c12-d5ca-4306-a87e-1bfc78454a2e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:34.326415 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1350c12-d5ca-4306-a87e-1bfc78454a2e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:34.326891 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1350c12-d5ca-4306-a87e-1bfc78454a2e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:34.327658 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1350c12-d5ca-4306-a87e-1bfc78454a2e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:34.328095 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1350c12-d5ca-4306-a87e-1bfc78454a2e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:34.328515 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e1350c12-d5ca-4306-a87e-1bfc78454a2e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:34.475745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e1350c12-d5ca-4306-a87e-1bfc78454a2e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:34.483620 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e1350c12-d5ca-4306-a87e-1bfc78454a2e tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.169484 Aug 18 12:24:34.484175 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 250/491] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:34 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:34.969150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:34.970673 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:34.977550 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:34.978023 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:34.978448 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:34.979158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:34.979658 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:34.980075 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:35.113531 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:35.121396 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:35.122888 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:35.124076 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8846c4db-eed7-491e-8b41-0350b03da4dc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1720 microversion: 2.20 time: 0.158855 Aug 18 12:24:35.124610 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 242/492] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:34 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:35.141053 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-19f5f91b-7244-4c0a-b435-16000bb80472 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:35.141599 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-19f5f91b-7244-4c0a-b435-16000bb80472 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:35.148625 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-19f5f91b-7244-4c0a-b435-16000bb80472 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:35.149109 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-19f5f91b-7244-4c0a-b435-16000bb80472 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:35.149543 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-19f5f91b-7244-4c0a-b435-16000bb80472 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:35.150238 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-19f5f91b-7244-4c0a-b435-16000bb80472 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:35.150687 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-19f5f91b-7244-4c0a-b435-16000bb80472 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:35.151107 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-19f5f91b-7244-4c0a-b435-16000bb80472 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:35.295649 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-19f5f91b-7244-4c0a-b435-16000bb80472 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:35.303405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-19f5f91b-7244-4c0a-b435-16000bb80472 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.166403 Aug 18 12:24:35.303993 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 251/493] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:35 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:35.505521 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-065af166-8b78-4cde-8d89-9f3a01d0427d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:35.506125 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-065af166-8b78-4cde-8d89-9f3a01d0427d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:35.512220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-065af166-8b78-4cde-8d89-9f3a01d0427d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:35.512696 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-065af166-8b78-4cde-8d89-9f3a01d0427d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:35.513130 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-065af166-8b78-4cde-8d89-9f3a01d0427d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:35.513815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-065af166-8b78-4cde-8d89-9f3a01d0427d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:35.514265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-065af166-8b78-4cde-8d89-9f3a01d0427d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:35.514687 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-065af166-8b78-4cde-8d89-9f3a01d0427d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:35.656262 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-065af166-8b78-4cde-8d89-9f3a01d0427d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:35.664303 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-065af166-8b78-4cde-8d89-9f3a01d0427d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.163190 Aug 18 12:24:35.664867 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 243/494] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:35 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:36.153174 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:36.153781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:36.160688 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:36.161166 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:36.161597 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:36.162286 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:36.162735 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:36.163159 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:36.181383 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=100 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:36.293595 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:36.303028 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:36.304564 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:36.305704 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a0c854d5-042e-45d2-a3fd-10ce07579f99 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1720 microversion: 2.20 time: 0.156484 Aug 18 12:24:36.306260 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 252/495] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:36 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:36.323970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4cfe9e5b-7e93-40f8-b430-586e9519e09a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:36.324579 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4cfe9e5b-7e93-40f8-b430-586e9519e09a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:36.330950 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4cfe9e5b-7e93-40f8-b430-586e9519e09a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:36.332037 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4cfe9e5b-7e93-40f8-b430-586e9519e09a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:36.332479 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4cfe9e5b-7e93-40f8-b430-586e9519e09a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:36.333158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4cfe9e5b-7e93-40f8-b430-586e9519e09a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:36.333608 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4cfe9e5b-7e93-40f8-b430-586e9519e09a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:36.334566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4cfe9e5b-7e93-40f8-b430-586e9519e09a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:36.465628 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4cfe9e5b-7e93-40f8-b430-586e9519e09a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:36.474113 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4cfe9e5b-7e93-40f8-b430-586e9519e09a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.153965 Aug 18 12:24:36.474676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 244/496] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:36 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:36.686124 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1bd5c4ae-7d77-4547-b914-d34f737c46b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:36.686670 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1bd5c4ae-7d77-4547-b914-d34f737c46b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:36.692885 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1bd5c4ae-7d77-4547-b914-d34f737c46b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:36.693464 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1bd5c4ae-7d77-4547-b914-d34f737c46b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:36.693899 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1bd5c4ae-7d77-4547-b914-d34f737c46b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:36.694631 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1bd5c4ae-7d77-4547-b914-d34f737c46b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:36.695084 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1bd5c4ae-7d77-4547-b914-d34f737c46b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:36.695872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1bd5c4ae-7d77-4547-b914-d34f737c46b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:36.839506 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1bd5c4ae-7d77-4547-b914-d34f737c46b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:36.847458 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1bd5c4ae-7d77-4547-b914-d34f737c46b7 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.165307 Aug 18 12:24:36.847995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 253/497] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:36 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:37.328582 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:37.329192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:37.335616 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:37.336098 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:37.336538 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:37.337226 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:37.337678 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:37.338100 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:37.468621 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:37.477187 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:37.479074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:37.480270 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e4bb22aa-5a5d-4513-98b8-995677fa87c3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1720 microversion: 2.20 time: 0.155633 Aug 18 12:24:37.480837 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 245/498] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:37 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:37.494687 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-480d5cee-f48d-4ee0-a7f2-150b1ff0d152 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:37.495296 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-480d5cee-f48d-4ee0-a7f2-150b1ff0d152 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:37.501635 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-480d5cee-f48d-4ee0-a7f2-150b1ff0d152 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:37.502132 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-480d5cee-f48d-4ee0-a7f2-150b1ff0d152 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:37.502556 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-480d5cee-f48d-4ee0-a7f2-150b1ff0d152 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:37.503263 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-480d5cee-f48d-4ee0-a7f2-150b1ff0d152 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:37.503742 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-480d5cee-f48d-4ee0-a7f2-150b1ff0d152 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:37.504158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-480d5cee-f48d-4ee0-a7f2-150b1ff0d152 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:37.631035 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-480d5cee-f48d-4ee0-a7f2-150b1ff0d152 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:37.638844 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-480d5cee-f48d-4ee0-a7f2-150b1ff0d152 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.148018 Aug 18 12:24:37.639393 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 254/499] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:37 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:37.871030 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-3da6de81-10f7-45df-94fd-46aaf1d875e8 req-ef7506f9-1da4-482e-a2c6-998d7649dda1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4dfc92-fb5b-46f3-a14a-992de65d7adb", "name": "network-vif-unplugged", "status": "completed", "tag": "45eda560-60cf-411c-954a-1838984f4e8f"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:37.871346 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5b2a813f-0f45-4eb6-a0d1-8befd039c347 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:37.871955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5b2a813f-0f45-4eb6-a0d1-8befd039c347 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:37.878330 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b2a813f-0f45-4eb6-a0d1-8befd039c347 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:37.883908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b2a813f-0f45-4eb6-a0d1-8befd039c347 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:37.883908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b2a813f-0f45-4eb6-a0d1-8befd039c347 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:37.883908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b2a813f-0f45-4eb6-a0d1-8befd039c347 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:37.883908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b2a813f-0f45-4eb6-a0d1-8befd039c347 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:37.884817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-3da6de81-10f7-45df-94fd-46aaf1d875e8 req-ef7506f9-1da4-482e-a2c6-998d7649dda1 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:37.884923 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b2a813f-0f45-4eb6-a0d1-8befd039c347 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:37.885004 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-3da6de81-10f7-45df-94fd-46aaf1d875e8 req-ef7506f9-1da4-482e-a2c6-998d7649dda1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:37.885004 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-3da6de81-10f7-45df-94fd-46aaf1d875e8 req-ef7506f9-1da4-482e-a2c6-998d7649dda1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:37.893251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-3da6de81-10f7-45df-94fd-46aaf1d875e8 req-ef7506f9-1da4-482e-a2c6-998d7649dda1 service nova] Creating event network-vif-unplugged:45eda560-60cf-411c-954a-1838984f4e8f for instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb on hv-cinder-83602 Aug 18 12:24:37.898979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-3da6de81-10f7-45df-94fd-46aaf1d875e8 req-ef7506f9-1da4-482e-a2c6-998d7649dda1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037125 Aug 18 12:24:37.899618 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 246/500] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:24:38.031036 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5b2a813f-0f45-4eb6-a0d1-8befd039c347 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:38.038602 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5b2a813f-0f45-4eb6-a0d1-8befd039c347 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.171030 Aug 18 12:24:38.039168 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 255/501] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:37 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:38.505290 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:38.505891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:38.512066 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:38.512542 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:38.512972 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:38.513735 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:38.514205 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:38.514609 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:38.659818 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f35ad7b5-d688-419f-8823-01c340fdc038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:38.660427 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f35ad7b5-d688-419f-8823-01c340fdc038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:38.666864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f35ad7b5-d688-419f-8823-01c340fdc038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:38.667341 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f35ad7b5-d688-419f-8823-01c340fdc038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:38.667811 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f35ad7b5-d688-419f-8823-01c340fdc038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:38.668505 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f35ad7b5-d688-419f-8823-01c340fdc038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:38.668981 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f35ad7b5-d688-419f-8823-01c340fdc038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:38.669376 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f35ad7b5-d688-419f-8823-01c340fdc038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:38.709610 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:38.717848 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:38.719367 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:38.720554 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-aacee5f8-10a0-43f2-bdc7-54f2776af3ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1720 microversion: 2.20 time: 0.220691 Aug 18 12:24:38.721118 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 247/502] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:38 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:38.812602 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f35ad7b5-d688-419f-8823-01c340fdc038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:38.823481 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f35ad7b5-d688-419f-8823-01c340fdc038 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.167392 Aug 18 12:24:38.824256 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 256/503] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:38 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:39.060137 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-69406e06-98c9-42f5-8147-5a8e85eb6d36 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:39.060973 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-69406e06-98c9-42f5-8147-5a8e85eb6d36 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:39.066831 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69406e06-98c9-42f5-8147-5a8e85eb6d36 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:39.067314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69406e06-98c9-42f5-8147-5a8e85eb6d36 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:39.067777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69406e06-98c9-42f5-8147-5a8e85eb6d36 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:39.068466 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69406e06-98c9-42f5-8147-5a8e85eb6d36 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:39.068947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69406e06-98c9-42f5-8147-5a8e85eb6d36 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:39.069372 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69406e06-98c9-42f5-8147-5a8e85eb6d36 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:39.273789 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-69406e06-98c9-42f5-8147-5a8e85eb6d36 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:39.282360 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-69406e06-98c9-42f5-8147-5a8e85eb6d36 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.226130 Aug 18 12:24:39.282949 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 248/504] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:39 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:39.744304 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:39.744905 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:39.751475 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:39.751961 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:39.752397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:39.753086 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:39.753538 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:39.753963 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:39.844040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-be7d8abc-3852-48a7-8a67-198bbab2fae5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:39.844741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-be7d8abc-3852-48a7-8a67-198bbab2fae5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:39.851775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be7d8abc-3852-48a7-8a67-198bbab2fae5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:39.852340 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be7d8abc-3852-48a7-8a67-198bbab2fae5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:39.852894 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be7d8abc-3852-48a7-8a67-198bbab2fae5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:39.853653 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be7d8abc-3852-48a7-8a67-198bbab2fae5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:39.854183 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be7d8abc-3852-48a7-8a67-198bbab2fae5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:39.854611 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be7d8abc-3852-48a7-8a67-198bbab2fae5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:39.887978 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:39.896864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:39.898386 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:39.899613 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-622eda08-4f1c-4209-a2ce-a98c91bbdd8b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1720 microversion: 2.20 time: 0.159110 Aug 18 12:24:39.900168 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 257/505] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:39 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:39.984119 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-be7d8abc-3852-48a7-8a67-198bbab2fae5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:40.001022 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-be7d8abc-3852-48a7-8a67-198bbab2fae5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.160541 Aug 18 12:24:40.002210 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 249/506] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:39 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:40.305029 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1520d35d-9082-48a7-8572-f0d17264457a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:40.305523 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1520d35d-9082-48a7-8572-f0d17264457a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:40.311375 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1520d35d-9082-48a7-8572-f0d17264457a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:40.311883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1520d35d-9082-48a7-8572-f0d17264457a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:40.312324 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1520d35d-9082-48a7-8572-f0d17264457a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:40.313003 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1520d35d-9082-48a7-8572-f0d17264457a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:40.313478 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1520d35d-9082-48a7-8572-f0d17264457a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:40.313887 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1520d35d-9082-48a7-8572-f0d17264457a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:40.455374 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1520d35d-9082-48a7-8572-f0d17264457a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:40.463996 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1520d35d-9082-48a7-8572-f0d17264457a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.162729 Aug 18 12:24:40.464555 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 258/507] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:40 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:40.922438 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:40.923049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:40.929620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:40.930104 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:40.930536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:40.931227 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:40.931706 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:40.932129 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:41.022421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3be2f153-8900-428c-9343-d41d2ab8f61e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:41.023031 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3be2f153-8900-428c-9343-d41d2ab8f61e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:41.029541 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3be2f153-8900-428c-9343-d41d2ab8f61e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:41.029999 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3be2f153-8900-428c-9343-d41d2ab8f61e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:41.030433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3be2f153-8900-428c-9343-d41d2ab8f61e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:41.031124 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3be2f153-8900-428c-9343-d41d2ab8f61e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:41.031611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3be2f153-8900-428c-9343-d41d2ab8f61e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:41.032037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3be2f153-8900-428c-9343-d41d2ab8f61e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:41.066336 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:41.075215 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:41.076904 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:41.078106 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-776f72a5-4e4c-4bb2-866b-3614daa4aee8 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1720 microversion: 2.20 time: 0.159614 Aug 18 12:24:41.078673 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 250/508] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:40 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:41.168347 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3be2f153-8900-428c-9343-d41d2ab8f61e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:41.177613 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3be2f153-8900-428c-9343-d41d2ab8f61e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1735 microversion: 2.1 time: 0.159409 Aug 18 12:24:41.178351 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 259/509] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:41 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:41.485933 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ff0664c1-ff23-4895-9bbd-e5ed35bdc3fc tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:41.486545 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ff0664c1-ff23-4895-9bbd-e5ed35bdc3fc tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:41.492730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ff0664c1-ff23-4895-9bbd-e5ed35bdc3fc tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:41.493207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ff0664c1-ff23-4895-9bbd-e5ed35bdc3fc tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:41.493648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ff0664c1-ff23-4895-9bbd-e5ed35bdc3fc tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:41.494353 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ff0664c1-ff23-4895-9bbd-e5ed35bdc3fc tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:41.494805 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ff0664c1-ff23-4895-9bbd-e5ed35bdc3fc tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:41.495319 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ff0664c1-ff23-4895-9bbd-e5ed35bdc3fc tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:41.646010 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ff0664c1-ff23-4895-9bbd-e5ed35bdc3fc tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:41.654289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ff0664c1-ff23-4895-9bbd-e5ed35bdc3fc tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.172177 Aug 18 12:24:41.659144 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 251/510] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:41 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:42.102328 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:42.102934 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:42.109385 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.109862 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.110289 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.110975 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.111432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.111864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.200023 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2a1585d2-24b7-4f0c-b7ac-a0cd4b3ea5f6 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:42.200662 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2a1585d2-24b7-4f0c-b7ac-a0cd4b3ea5f6 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:42.207111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a1585d2-24b7-4f0c-b7ac-a0cd4b3ea5f6 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.207632 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a1585d2-24b7-4f0c-b7ac-a0cd4b3ea5f6 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.208097 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a1585d2-24b7-4f0c-b7ac-a0cd4b3ea5f6 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.208803 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a1585d2-24b7-4f0c-b7ac-a0cd4b3ea5f6 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.209257 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a1585d2-24b7-4f0c-b7ac-a0cd4b3ea5f6 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.209683 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a1585d2-24b7-4f0c-b7ac-a0cd4b3ea5f6 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.249117 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:42.257664 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:42.259466 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:42.260810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fba4f521-9ab9-4bf8-9ee9-9acdfa46db2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1723 microversion: 2.20 time: 0.163228 Aug 18 12:24:42.261525 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 260/511] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:42 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:42.284869 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-beccea63-6faa-48df-bd1c-5ad8c3cffbfe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "056a3015-2e66-4202-9f1c-bf9c6a9a193a"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:42.287882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-beccea63-6faa-48df-bd1c-5ad8c3cffbfe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:42.294002 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beccea63-6faa-48df-bd1c-5ad8c3cffbfe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.294486 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beccea63-6faa-48df-bd1c-5ad8c3cffbfe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.294919 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beccea63-6faa-48df-bd1c-5ad8c3cffbfe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.295647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beccea63-6faa-48df-bd1c-5ad8c3cffbfe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.296147 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beccea63-6faa-48df-bd1c-5ad8c3cffbfe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.301533 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beccea63-6faa-48df-bd1c-5ad8c3cffbfe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.348862 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2a1585d2-24b7-4f0c-b7ac-a0cd4b3ea5f6 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:42.359464 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2a1585d2-24b7-4f0c-b7ac-a0cd4b3ea5f6 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1715 microversion: 2.1 time: 0.163846 Aug 18 12:24:42.360141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 252/512] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:42 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:42.412715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c8745397-bb8b-451c-86a0-2158cb34871a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:42.413220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c8745397-bb8b-451c-86a0-2158cb34871a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:42.419084 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8745397-bb8b-451c-86a0-2158cb34871a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.419612 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8745397-bb8b-451c-86a0-2158cb34871a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.420053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8745397-bb8b-451c-86a0-2158cb34871a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.420760 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8745397-bb8b-451c-86a0-2158cb34871a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.421222 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8745397-bb8b-451c-86a0-2158cb34871a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.421649 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8745397-bb8b-451c-86a0-2158cb34871a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.504967 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-c8745397-bb8b-451c-86a0-2158cb34871a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lazy-loading 'services' on Instance uuid 37989372-191d-4fe3-be7a-6339e6b4d03e {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:24:42.722528 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c8745397-bb8b-451c-86a0-2158cb34871a tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "DELETE /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e/os-volume_attachments/7168ca65-1dcb-4e82-b859-c2dde42369e9" status: 202 len: 0 microversion: 2.1 time: 0.314143 Aug 18 12:24:42.724032 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 253/513] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:24:42 2022] DELETE /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e/os-volume_attachments/7168ca65-1dcb-4e82-b859-c2dde42369e9 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:24:42.730481 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:42.730481 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:42.738040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.739280 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.739763 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.740458 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.740975 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.741400 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.828189 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] HTTP exception thrown: Cannot 'detach_volume' instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e while it is in vm_state rescued Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Request method failure captured: Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: DELETE /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments/b505ffc5-b0df-4bba-a2c6-12559c7026a7 HTTP/1.1 Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i6Pc1iShlC4ACTcOWwbv896mVUJ_VCuPhjuPkGFza81A1LvrVOukwsF5_eB3xdrTQK1i8i79gID74Vli7zDHlRdCqloU9q3_SZ2580Is2rSbBhnRdmwSF3kQoOWg2EYGof8CdvJE5X_A8zanheUiphbBAGE7-CpkQl3RNeVfWW7cqs Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 965cf5f488364e0ea8b52cdc78de2641 Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:24:42.829870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:24:42.831474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:24:42.831474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:24:42.831474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 965cf5f488364e0ea8b52cdc78de2641 Aug 18 12:24:42.831474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:24:42.831474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-ServerRescueNegativeTestJSON-934320463-project Aug 18 12:24:42.831474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:24:42.831474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:24:42.831474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 2e8380a466484c83bca842518d171048 Aug 18 12:24:42.831474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-ServerRescueNegativeTestJSON-934320463-project Aug 18 12:24:42.831474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:24:42.831474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Cannot 'detach_volume' instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e while it is in vm_state rescued Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'server_id': 'e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e', 'id': 'b505ffc5-b0df-4bba-a2c6-12559c7026a7'} Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:24:42.832356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e while it is in vm_state rescued Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e while it is in vm_state rescued Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:24:42.833843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Returning 409 to user: Cannot 'detach_volume' instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e while it is in vm_state rescued {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:24:42.834985 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-37b7a98e-0919-4290-8373-c0f60d81b9e3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments/b505ffc5-b0df-4bba-a2c6-12559c7026a7" status: 409 len: 152 microversion: 2.1 time: 0.106853 Aug 18 12:24:42.834985 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 254/514] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:24:42 2022] DELETE /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments/b505ffc5-b0df-4bba-a2c6-12559c7026a7 => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 12:24:42.837785 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8ffc4ccf-6940-4a83-8ea2-ffabfe00d59a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:42.841549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8ffc4ccf-6940-4a83-8ea2-ffabfe00d59a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:42.845390 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8ffc4ccf-6940-4a83-8ea2-ffabfe00d59a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.845882 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8ffc4ccf-6940-4a83-8ea2-ffabfe00d59a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.846311 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8ffc4ccf-6940-4a83-8ea2-ffabfe00d59a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.847149 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8ffc4ccf-6940-4a83-8ea2-ffabfe00d59a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.848138 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8ffc4ccf-6940-4a83-8ea2-ffabfe00d59a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.848562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8ffc4ccf-6940-4a83-8ea2-ffabfe00d59a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.999161 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8ffc4ccf-6940-4a83-8ea2-ffabfe00d59a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:43.008200 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8ffc4ccf-6940-4a83-8ea2-ffabfe00d59a tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.174352 Aug 18 12:24:43.008786 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 255/515] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:42 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:43.013489 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-27cbf6b9-a21f-472e-8ab2-bc1e67b4cecf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:43.014025 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-27cbf6b9-a21f-472e-8ab2-bc1e67b4cecf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:43.020792 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27cbf6b9-a21f-472e-8ab2-bc1e67b4cecf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.021448 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27cbf6b9-a21f-472e-8ab2-bc1e67b4cecf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.022064 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27cbf6b9-a21f-472e-8ab2-bc1e67b4cecf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:43.022772 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27cbf6b9-a21f-472e-8ab2-bc1e67b4cecf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.023227 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27cbf6b9-a21f-472e-8ab2-bc1e67b4cecf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.023675 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-27cbf6b9-a21f-472e-8ab2-bc1e67b4cecf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:43.071059 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:43.220123 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-beccea63-6faa-48df-bd1c-5ad8c3cffbfe tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "POST /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.939182 Aug 18 12:24:43.220948 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 261/516] 10.222.0.98 () {62 vars in 1364 bytes} [Thu Aug 18 12:24:42 2022] POST /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-volume_attachments => generated 188 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:24:43.228062 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-27cbf6b9-a21f-472e-8ab2-bc1e67b4cecf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "POST /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/action" status: 202 len: 0 microversion: 2.1 time: 0.217997 Aug 18 12:24:43.228690 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 256/517] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:24:43 2022] POST /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:24:43.239926 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-67375ece-2405-44b8-9c17-abc4b317698a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:43.239926 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-67375ece-2405-44b8-9c17-abc4b317698a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:43.247112 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67375ece-2405-44b8-9c17-abc4b317698a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.247751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67375ece-2405-44b8-9c17-abc4b317698a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.248190 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67375ece-2405-44b8-9c17-abc4b317698a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:43.248897 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67375ece-2405-44b8-9c17-abc4b317698a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.249352 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67375ece-2405-44b8-9c17-abc4b317698a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.249785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67375ece-2405-44b8-9c17-abc4b317698a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:43.359561 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e204c0cc-4875-44fb-a9f7-1ad6a48d4048 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:43.360352 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e204c0cc-4875-44fb-a9f7-1ad6a48d4048 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:43.367901 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e204c0cc-4875-44fb-a9f7-1ad6a48d4048 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.373473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e204c0cc-4875-44fb-a9f7-1ad6a48d4048 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.373945 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e204c0cc-4875-44fb-a9f7-1ad6a48d4048 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:43.374693 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e204c0cc-4875-44fb-a9f7-1ad6a48d4048 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.375184 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e204c0cc-4875-44fb-a9f7-1ad6a48d4048 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.375713 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e204c0cc-4875-44fb-a9f7-1ad6a48d4048 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:43.400698 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-67375ece-2405-44b8-9c17-abc4b317698a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:43.411203 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-67375ece-2405-44b8-9c17-abc4b317698a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1723 microversion: 2.1 time: 0.178202 Aug 18 12:24:43.412525 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 262/518] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:43 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:43.433597 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e204c0cc-4875-44fb-a9f7-1ad6a48d4048 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121244) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 18 12:24:43.720043 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e204c0cc-4875-44fb-a9f7-1ad6a48d4048 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "POST /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/action" status: 202 len: 0 microversion: 2.20 time: 0.364807 Aug 18 12:24:43.729780 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:43.730678 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:43.736803 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 257/519] 10.222.0.98 () {62 vars in 1319 bytes} [Thu Aug 18 12:24:43 2022] POST /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:24:43.740522 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.746864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.746864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:43.746864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.746864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.748137 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:43.913801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:43.923278 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:43.924873 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:43.926359 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3ea0cccc-676e-4e83-8d37-898a8e44cdeb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1749 microversion: 2.20 time: 0.200584 Aug 18 12:24:43.926923 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 263/520] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:43 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1749 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:44.030313 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-bff0d0da-4398-437e-9c8a-434dcffb20d8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:44.030970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-bff0d0da-4398-437e-9c8a-434dcffb20d8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:44.037372 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bff0d0da-4398-437e-9c8a-434dcffb20d8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.037861 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bff0d0da-4398-437e-9c8a-434dcffb20d8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.038359 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bff0d0da-4398-437e-9c8a-434dcffb20d8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.039376 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bff0d0da-4398-437e-9c8a-434dcffb20d8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.040041 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bff0d0da-4398-437e-9c8a-434dcffb20d8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.040473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bff0d0da-4398-437e-9c8a-434dcffb20d8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.185308 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bff0d0da-4398-437e-9c8a-434dcffb20d8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:44.194109 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-bff0d0da-4398-437e-9c8a-434dcffb20d8 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1756 microversion: 2.1 time: 0.167679 Aug 18 12:24:44.194679 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 258/521] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:44 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:44.433090 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-75ba325c-f924-4da9-8e18-f5335ae9f0b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:44.442128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-75ba325c-f924-4da9-8e18-f5335ae9f0b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:44.449840 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75ba325c-f924-4da9-8e18-f5335ae9f0b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.450335 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75ba325c-f924-4da9-8e18-f5335ae9f0b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.450793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75ba325c-f924-4da9-8e18-f5335ae9f0b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.451705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75ba325c-f924-4da9-8e18-f5335ae9f0b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.452312 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75ba325c-f924-4da9-8e18-f5335ae9f0b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.452896 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75ba325c-f924-4da9-8e18-f5335ae9f0b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.649430 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-75ba325c-f924-4da9-8e18-f5335ae9f0b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:44.657915 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-75ba325c-f924-4da9-8e18-f5335ae9f0b8 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1723 microversion: 2.1 time: 0.228658 Aug 18 12:24:44.658759 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 264/522] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:44 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:44.915313 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-edc9893d-a06d-4d0d-94f7-d2a852732074 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:44.915907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-edc9893d-a06d-4d0d-94f7-d2a852732074 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:44.922171 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edc9893d-a06d-4d0d-94f7-d2a852732074 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.922651 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edc9893d-a06d-4d0d-94f7-d2a852732074 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.923085 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edc9893d-a06d-4d0d-94f7-d2a852732074 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.923844 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edc9893d-a06d-4d0d-94f7-d2a852732074 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.924253 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edc9893d-a06d-4d0d-94f7-d2a852732074 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.924681 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edc9893d-a06d-4d0d-94f7-d2a852732074 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.949902 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:44.950548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:44.951022 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-edc9893d-a06d-4d0d-94f7-d2a852732074 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Going to try to terminate instance {{(pid=121244) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:24:44.956556 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.957678 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.958116 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.958809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.959259 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.959710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:45.096674 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:45.105099 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:45.106510 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:45.107687 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3b51ae1b-7aec-4fd2-a401-7e729d73277a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1749 microversion: 2.20 time: 0.161610 Aug 18 12:24:45.108238 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 265/523] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:44 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:45.215717 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-17f36f14-74c5-44a8-8b29-48c2ab13371d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:45.216321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-17f36f14-74c5-44a8-8b29-48c2ab13371d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:45.222341 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-17f36f14-74c5-44a8-8b29-48c2ab13371d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:45.223436 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-17f36f14-74c5-44a8-8b29-48c2ab13371d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:45.223878 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-17f36f14-74c5-44a8-8b29-48c2ab13371d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:45.224568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-17f36f14-74c5-44a8-8b29-48c2ab13371d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:45.225020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-17f36f14-74c5-44a8-8b29-48c2ab13371d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:45.225450 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-17f36f14-74c5-44a8-8b29-48c2ab13371d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:45.245849 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:45.249035 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-edc9893d-a06d-4d0d-94f7-d2a852732074 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "DELETE /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 204 len: 0 microversion: 2.1 time: 0.337057 Aug 18 12:24:45.249727 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 259/524] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:24:44 2022] DELETE /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:24:45.258195 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d92a90ec-8071-4be3-8f5e-36df227a25ff tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:45.259034 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d92a90ec-8071-4be3-8f5e-36df227a25ff tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:45.265076 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d92a90ec-8071-4be3-8f5e-36df227a25ff tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:45.265568 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d92a90ec-8071-4be3-8f5e-36df227a25ff tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:45.266005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d92a90ec-8071-4be3-8f5e-36df227a25ff tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:45.266705 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d92a90ec-8071-4be3-8f5e-36df227a25ff tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:45.267158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d92a90ec-8071-4be3-8f5e-36df227a25ff tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:45.267639 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d92a90ec-8071-4be3-8f5e-36df227a25ff tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:45.377604 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-17f36f14-74c5-44a8-8b29-48c2ab13371d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:45.386351 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-17f36f14-74c5-44a8-8b29-48c2ab13371d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1759 microversion: 2.1 time: 0.174529 Aug 18 12:24:45.387010 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 266/525] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:45 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:45.407822 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d92a90ec-8071-4be3-8f5e-36df227a25ff tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:45.415195 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d92a90ec-8071-4be3-8f5e-36df227a25ff tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1515 microversion: 2.1 time: 0.160962 Aug 18 12:24:45.415786 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 260/526] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:45 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:45.681215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-62ab53a2-e6e6-4669-b426-1e856ae6e7d4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:45.681743 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-62ab53a2-e6e6-4669-b426-1e856ae6e7d4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:45.688265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62ab53a2-e6e6-4669-b426-1e856ae6e7d4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:45.688744 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62ab53a2-e6e6-4669-b426-1e856ae6e7d4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:45.689180 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62ab53a2-e6e6-4669-b426-1e856ae6e7d4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:45.689875 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62ab53a2-e6e6-4669-b426-1e856ae6e7d4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:45.690328 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62ab53a2-e6e6-4669-b426-1e856ae6e7d4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:45.690752 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-62ab53a2-e6e6-4669-b426-1e856ae6e7d4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:45.819827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-62ab53a2-e6e6-4669-b426-1e856ae6e7d4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:45.827629 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-62ab53a2-e6e6-4669-b426-1e856ae6e7d4 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1723 microversion: 2.1 time: 0.151157 Aug 18 12:24:45.828183 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 267/527] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:45 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:46.131362 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:46.132032 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:46.138495 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:46.138979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:46.139436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:46.140129 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:46.140580 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:46.141004 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:46.271384 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:46.279758 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:46.281381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:46.282530 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-993e71e8-561c-4d45-8833-85763874b11f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1749 microversion: 2.20 time: 0.155577 Aug 18 12:24:46.283075 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 261/528] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:46 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:46.436160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c4c1902f-6a93-491c-a14c-7f3a9d490fcf tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:46.436672 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c4c1902f-6a93-491c-a14c-7f3a9d490fcf tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:46.444950 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c4c1902f-6a93-491c-a14c-7f3a9d490fcf tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:46.445424 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c4c1902f-6a93-491c-a14c-7f3a9d490fcf tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:46.447545 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c4c1902f-6a93-491c-a14c-7f3a9d490fcf tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:46.447545 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c4c1902f-6a93-491c-a14c-7f3a9d490fcf tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:46.447545 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c4c1902f-6a93-491c-a14c-7f3a9d490fcf tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:46.447545 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c4c1902f-6a93-491c-a14c-7f3a9d490fcf tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:46.578303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c4c1902f-6a93-491c-a14c-7f3a9d490fcf tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:46.586284 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c4c1902f-6a93-491c-a14c-7f3a9d490fcf tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1515 microversion: 2.1 time: 0.154351 Aug 18 12:24:46.586845 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 268/529] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:46 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:46.849384 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c8fa82e0-8e90-42e9-8eea-8e8b86397f5a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:46.849992 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c8fa82e0-8e90-42e9-8eea-8e8b86397f5a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:46.856406 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8fa82e0-8e90-42e9-8eea-8e8b86397f5a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:46.856888 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8fa82e0-8e90-42e9-8eea-8e8b86397f5a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:46.857325 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8fa82e0-8e90-42e9-8eea-8e8b86397f5a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:46.858017 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8fa82e0-8e90-42e9-8eea-8e8b86397f5a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:46.858472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8fa82e0-8e90-42e9-8eea-8e8b86397f5a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:46.858898 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8fa82e0-8e90-42e9-8eea-8e8b86397f5a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:46.989942 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c8fa82e0-8e90-42e9-8eea-8e8b86397f5a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:46.998011 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c8fa82e0-8e90-42e9-8eea-8e8b86397f5a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1723 microversion: 2.1 time: 0.153071 Aug 18 12:24:46.998837 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 262/530] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:46 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:47.305376 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:47.305897 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:47.313710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:47.314188 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:47.314617 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:47.315337 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:47.315813 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:47.316235 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:47.452633 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:47.461627 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:47.463183 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:47.464396 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-9454d817-a24f-454c-ae39-f8c5088acc5d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1749 microversion: 2.20 time: 0.162968 Aug 18 12:24:47.464954 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 269/531] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:47 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:47.607156 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d63ddb92-90d1-483d-8e02-db74866e6b2d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:47.607740 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d63ddb92-90d1-483d-8e02-db74866e6b2d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:47.614507 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d63ddb92-90d1-483d-8e02-db74866e6b2d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:47.614987 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d63ddb92-90d1-483d-8e02-db74866e6b2d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:47.615437 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d63ddb92-90d1-483d-8e02-db74866e6b2d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:47.616133 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d63ddb92-90d1-483d-8e02-db74866e6b2d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:47.616582 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d63ddb92-90d1-483d-8e02-db74866e6b2d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:47.617004 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d63ddb92-90d1-483d-8e02-db74866e6b2d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:47.744108 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d63ddb92-90d1-483d-8e02-db74866e6b2d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:47.751744 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d63ddb92-90d1-483d-8e02-db74866e6b2d tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1515 microversion: 2.1 time: 0.148425 Aug 18 12:24:47.752308 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 263/532] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:47 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:48.020007 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1a9394db-f3e2-47fe-8835-080ae523c4ce tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:48.020623 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1a9394db-f3e2-47fe-8835-080ae523c4ce tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:48.026688 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1a9394db-f3e2-47fe-8835-080ae523c4ce tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:48.027171 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1a9394db-f3e2-47fe-8835-080ae523c4ce tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:48.027694 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1a9394db-f3e2-47fe-8835-080ae523c4ce tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:48.032554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1a9394db-f3e2-47fe-8835-080ae523c4ce tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:48.032554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1a9394db-f3e2-47fe-8835-080ae523c4ce tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:48.032554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1a9394db-f3e2-47fe-8835-080ae523c4ce tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:48.159079 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1a9394db-f3e2-47fe-8835-080ae523c4ce tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:48.167060 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1a9394db-f3e2-47fe-8835-080ae523c4ce tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1723 microversion: 2.1 time: 0.151848 Aug 18 12:24:48.167651 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 270/533] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:48 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:48.488093 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:48.489399 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:48.495397 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:48.495901 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:48.496349 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:48.497039 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:48.497490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:48.497915 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:48.683057 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:48.691644 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:48.693187 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:48.694351 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-636cfb09-057a-4d3d-8c7a-50a5ed3e3285 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1751 microversion: 2.20 time: 0.210468 Aug 18 12:24:48.694896 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 264/534] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:48 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:48.774161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-9629d72b-9d11-49bb-8a07-3f0a784e9ed4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:48.775361 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-9629d72b-9d11-49bb-8a07-3f0a784e9ed4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:48.783020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9629d72b-9d11-49bb-8a07-3f0a784e9ed4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:48.783020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9629d72b-9d11-49bb-8a07-3f0a784e9ed4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:48.783020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9629d72b-9d11-49bb-8a07-3f0a784e9ed4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:48.783403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9629d72b-9d11-49bb-8a07-3f0a784e9ed4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:48.783623 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9629d72b-9d11-49bb-8a07-3f0a784e9ed4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:48.784042 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9629d72b-9d11-49bb-8a07-3f0a784e9ed4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:48.923321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-9629d72b-9d11-49bb-8a07-3f0a784e9ed4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:48.930824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-9629d72b-9d11-49bb-8a07-3f0a784e9ed4 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1515 microversion: 2.1 time: 0.161281 Aug 18 12:24:48.931397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 271/535] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:48 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:49.149481 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-c312881d-b682-4fa7-96f4-fcd4da020709 req-d98a2fdb-cb33-4722-9c83-0ae2e7685fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37989372-191d-4fe3-be7a-6339e6b4d03e", "name": "network-vif-deleted", "tag": "fc84efa4-7f15-453b-ba54-640983f1ed4e"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:49.159794 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-c312881d-b682-4fa7-96f4-fcd4da020709 req-d98a2fdb-cb33-4722-9c83-0ae2e7685fdb service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:49.160297 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-c312881d-b682-4fa7-96f4-fcd4da020709 req-d98a2fdb-cb33-4722-9c83-0ae2e7685fdb service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:49.160723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-c312881d-b682-4fa7-96f4-fcd4da020709 req-d98a2fdb-cb33-4722-9c83-0ae2e7685fdb service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:49.171864 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-c312881d-b682-4fa7-96f4-fcd4da020709 req-d98a2fdb-cb33-4722-9c83-0ae2e7685fdb service nova] Creating event network-vif-deleted:fc84efa4-7f15-453b-ba54-640983f1ed4e for instance 37989372-191d-4fe3-be7a-6339e6b4d03e on hv-cinder-83602 Aug 18 12:24:49.176748 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-c312881d-b682-4fa7-96f4-fcd4da020709 req-d98a2fdb-cb33-4722-9c83-0ae2e7685fdb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030996 Aug 18 12:24:49.178254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 265/536] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:24:49.188680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c375e708-f6d0-4737-8711-133e294a289f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:49.189288 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c375e708-f6d0-4737-8711-133e294a289f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:49.200389 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c375e708-f6d0-4737-8711-133e294a289f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:49.207020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c375e708-f6d0-4737-8711-133e294a289f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:49.207020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c375e708-f6d0-4737-8711-133e294a289f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:49.207020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c375e708-f6d0-4737-8711-133e294a289f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:49.207020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c375e708-f6d0-4737-8711-133e294a289f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:49.208037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c375e708-f6d0-4737-8711-133e294a289f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:49.336816 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c375e708-f6d0-4737-8711-133e294a289f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:49.345104 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c375e708-f6d0-4737-8711-133e294a289f tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1729 microversion: 2.1 time: 0.160230 Aug 18 12:24:49.345675 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 272/537] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:49 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:49.367733 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2cc2eaba-6705-4673-b699-faaa691e3933 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:49.368299 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2cc2eaba-6705-4673-b699-faaa691e3933 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:49.374501 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc2eaba-6705-4673-b699-faaa691e3933 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:49.374983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc2eaba-6705-4673-b699-faaa691e3933 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:49.375445 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc2eaba-6705-4673-b699-faaa691e3933 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:49.376121 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc2eaba-6705-4673-b699-faaa691e3933 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:49.376570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc2eaba-6705-4673-b699-faaa691e3933 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:49.376991 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc2eaba-6705-4673-b699-faaa691e3933 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:49.457773 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2cc2eaba-6705-4673-b699-faaa691e3933 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094268 Aug 18 12:24:49.458353 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 266/538] 10.222.0.98 () {58 vars in 1275 bytes} [Thu Aug 18 12:24:49 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:24:49.718672 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:49.719306 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:49.726372 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:49.737441 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:49.737441 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:49.737441 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:49.737441 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:49.737839 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:49.952442 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:49.955287 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:49.960338 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:49.961315 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:49.961862 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:49.962645 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:49.963176 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:49.963756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:49.975027 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:49.984164 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:49.985683 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:49.987124 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-db2b961f-3222-4a07-a8a2-4b0ed21fcf64 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1751 microversion: 2.20 time: 0.272647 Aug 18 12:24:49.987713 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 273/539] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:49 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1751 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:50.032951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:50.033642 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:50.034200 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:50.034803 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lazy-loading 'fault' on Instance uuid 37989372-191d-4fe3-be7a-6339e6b4d03e {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:24:50.089632 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b767c363bb4a6fa3530f6a677e09f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01ab18435804769bb4ae0bf86d4d99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:50.097354 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5e5ba365-1b4e-4f19-aea8-d8815349781f tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 200 len: 1309 microversion: 2.1 time: 0.149354 Aug 18 12:24:50.098782 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 267/540] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:49 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 1309 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:50.536489 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-3f61c4cc-d3ef-41d3-86c8-b46301a6abcf req-d2a4a087-5248-48af-a46b-20fd725d2f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e", "tag": "5d0b49eb-e985-4312-8c18-82dd61f5b4ea"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:50.549378 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-3f61c4cc-d3ef-41d3-86c8-b46301a6abcf req-d2a4a087-5248-48af-a46b-20fd725d2f76 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:50.550195 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-3f61c4cc-d3ef-41d3-86c8-b46301a6abcf req-d2a4a087-5248-48af-a46b-20fd725d2f76 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:50.550706 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-3f61c4cc-d3ef-41d3-86c8-b46301a6abcf req-d2a4a087-5248-48af-a46b-20fd725d2f76 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:50.562365 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-3f61c4cc-d3ef-41d3-86c8-b46301a6abcf req-d2a4a087-5248-48af-a46b-20fd725d2f76 service nova] Creating event network-changed:5d0b49eb-e985-4312-8c18-82dd61f5b4ea for instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e on hv-cinder-83602 Aug 18 12:24:50.568418 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-3f61c4cc-d3ef-41d3-86c8-b46301a6abcf req-d2a4a087-5248-48af-a46b-20fd725d2f76 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038057 Aug 18 12:24:50.569009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 274/541] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:24:51.009936 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:51.011171 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:51.018033 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:51.018797 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:51.019389 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:51.020867 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:51.021478 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:51.022109 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:51.122876 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:51.123624 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] [instance: 37989372-191d-4fe3-be7a-6339e6b4d03e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:51.130093 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:51.130572 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:51.131004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:51.131734 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:51.132184 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:51.132600 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:51.148160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] HTTP exception thrown: Instance 37989372-191d-4fe3-be7a-6339e6b4d03e could not be found. Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Request method failure captured: Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e HTTP/1.1 Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i79m9Mgi_G4FtuzYW5aOivnzs2drFhqG6q49TtV8VvRrIbjK2eLbo5MhgxRAKrfI2GR-LXIq4B8LuWJ9y_afc1ChbjtPG2GffO634495UKTqfh7Chdx1uKFPxODqmkWZSLwYwilUyjzmrXIZaPAvZFC5IbWXTDMPALDWG-r3HQaNyg Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: c01ab18435804769bb4ae0bf86d4d99d Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2115860944 Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:24:51.150103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c01ab18435804769bb4ae0bf86d4d99d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c01ab18435804769bb4ae0bf86d4d99d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c01ab18435804769bb4ae0bf86d4d99d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c01ab18435804769bb4ae0bf86d4d99d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-VolumesSnapshotTestJSON-2115860944 Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: c01ab18435804769bb4ae0bf86d4d99d Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2115860944 Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-VolumesSnapshotTestJSON-2115860944-project Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: e6b767c363bb4a6fa3530f6a677e09f2 Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-VolumesSnapshotTestJSON-2115860944-project Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 37989372-191d-4fe3-be7a-6339e6b4d03e could not be found. Aug 18 12:24:51.151797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '37989372-191d-4fe3-be7a-6339e6b4d03e'} Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37989372-191d-4fe3-be7a-6339e6b4d03e could not be found. Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:24:51.152715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37989372-191d-4fe3-be7a-6339e6b4d03e could not be found. Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37989372-191d-4fe3-be7a-6339e6b4d03e could not be found. Aug 18 12:24:51.154162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:24:51.155354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] Returning 404 to user: Instance 37989372-191d-4fe3-be7a-6339e6b4d03e could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:24:51.155354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8f4b9df8-14f5-4c26-8c02-08b72f081e81 tempest-VolumesSnapshotTestJSON-2115860944 tempest-VolumesSnapshotTestJSON-2115860944-project] 10.222.0.98 "GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e" status: 404 len: 111 microversion: 2.1 time: 0.033468 Aug 18 12:24:51.157539 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 275/542] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:51 2022] GET /compute/v2.1/servers/37989372-191d-4fe3-be7a-6339e6b4d03e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:24:51.322902 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:51.333998 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:51.335500 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:51.341191 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-262b9ef6-06d1-4a65-a8f1-6cd9c29e50de tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.335082 Aug 18 12:24:51.341781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 268/543] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:51 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:52.366867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:52.369289 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:52.372384 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=86 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:52.378669 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:52.379716 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:52.381449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:52.382919 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:52.385002 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:52.386318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:52.550858 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:52.561293 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:52.563312 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:52.564636 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0f3dbee7-39c1-4380-b2a5-7cd9a66633a9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.203505 Aug 18 12:24:52.565356 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 276/544] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:52 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:52.586466 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-a6c5023c-7f61-467a-80e5-3cd7cd888c70 req-f939c76e-5f74-43ce-bc14-79a0f6e49a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e", "tag": "5d0b49eb-e985-4312-8c18-82dd61f5b4ea"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:52.596604 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:52.599485 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-a6c5023c-7f61-467a-80e5-3cd7cd888c70 req-f939c76e-5f74-43ce-bc14-79a0f6e49a86 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:52.600145 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-a6c5023c-7f61-467a-80e5-3cd7cd888c70 req-f939c76e-5f74-43ce-bc14-79a0f6e49a86 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:52.600970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-a6c5023c-7f61-467a-80e5-3cd7cd888c70 req-f939c76e-5f74-43ce-bc14-79a0f6e49a86 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:52.614351 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-a6c5023c-7f61-467a-80e5-3cd7cd888c70 req-f939c76e-5f74-43ce-bc14-79a0f6e49a86 service nova] Creating event network-changed:5d0b49eb-e985-4312-8c18-82dd61f5b4ea for instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e on hv-cinder-83602 Aug 18 12:24:52.619919 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-a6c5023c-7f61-467a-80e5-3cd7cd888c70 req-f939c76e-5f74-43ce-bc14-79a0f6e49a86 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037882 Aug 18 12:24:52.621095 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 269/545] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:24:53.591621 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:53.592437 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:53.599609 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:53.600226 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:53.600670 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:53.601550 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:53.602004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:53.602435 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:53.744067 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:53.755670 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:53.758210 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:53.760132 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-bb58adcd-2b97-441e-978b-7cac408a57c0 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.172734 Aug 18 12:24:53.767720 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 277/546] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:53 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:54.790515 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:54.791210 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:54.797874 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:54.798352 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:54.798779 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:54.799498 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:54.799945 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:54.800361 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:54.940306 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:54.951503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:54.951503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:54.951801 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-feda6a3c-a7fb-4201-b4e4-4de645b44279 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.166696 Aug 18 12:24:54.952358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 270/547] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:54 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:55.977798 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:55.978476 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:55.988026 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:55.988563 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:55.989017 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:55.989756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:55.990256 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:55.991511 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:56.152180 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:56.166914 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:56.168434 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:56.169583 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e3d3ca66-b649-494a-83f2-d5937551022c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.195975 Aug 18 12:24:56.170142 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 278/548] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:55 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:57.193748 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:57.194443 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:57.201259 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:57.201752 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:57.202185 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:57.202888 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:57.203339 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:57.203801 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:57.366476 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:57.369965 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:57.382652 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:57.385445 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:57.389272 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5a18afc3-1bea-4181-bee5-84ecaefe3560 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.197414 Aug 18 12:24:57.389272 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 271/549] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:57 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:24:58.419891 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:58.420607 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:58.427357 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:58.428464 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:58.429112 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:58.429874 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:58.430390 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:58.430873 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:58.584902 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:58.593881 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:58.595455 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:58.600502 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-337f5237-7afa-4c99-b3a8-204896b477b9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.184242 Aug 18 12:24:58.600502 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 279/550] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:58 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:24:59.620252 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:59.620878 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:59.628358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:59.628852 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:59.629295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:59.630021 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:59.630479 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:59.631437 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:59.785269 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:59.796516 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:59.798287 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:59.799551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c90a16cb-1c0b-4f18-a830-92d191d0b807 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.183591 Aug 18 12:24:59.800389 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 272/551] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:24:59 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:00.824146 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:00.824758 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:00.831509 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:00.831992 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:00.832423 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:00.833117 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:00.833561 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:00.834655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:01.006374 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:01.015519 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:01.024689 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:01.025914 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b43697d1-aa64-4c2e-8685-83d54a47d428 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.205658 Aug 18 12:25:01.026476 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 280/552] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:00 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:02.049627 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:02.050225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:02.057333 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:02.058140 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:02.058572 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:02.059259 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:02.059774 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:02.060151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:02.233134 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:02.241970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:02.243537 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:02.244699 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5e1409b3-29e4-4a52-b9f5-4533d881bf0e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.198969 Aug 18 12:25:02.245260 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 273/553] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:02 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:25:03.267654 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:03.268267 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:03.274639 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:03.275112 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:03.275579 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:03.276266 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:03.276714 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:03.277140 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:03.414210 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:03.423115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:03.424695 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:03.425943 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5da60a1d-cdee-4b99-a044-b129956535f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.162143 Aug 18 12:25:03.426493 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 281/554] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:03 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:04.450388 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:04.450934 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:04.457320 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:04.457806 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:04.458261 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:04.459092 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:04.459389 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:04.459833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:04.592016 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:04.600453 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:04.602463 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:04.603646 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0125b605-4a3c-4be2-819e-817a139d47b7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.157214 Aug 18 12:25:04.604204 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 274/555] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:04 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:05.627518 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:05.628106 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:05.635155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:05.635679 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:05.636115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:05.636800 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:05.637247 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:05.637663 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:06.004832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:06.013069 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:06.014590 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:06.015756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a88b2da2-8f60-46e6-8093-a7f1d0955f1c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.392114 Aug 18 12:25:06.016311 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 282/556] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:05 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:06.098727 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-46f7da43-e44b-4a23-8559-8c20529dd333 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:06.100950 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-46f7da43-e44b-4a23-8559-8c20529dd333 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:06.108010 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46f7da43-e44b-4a23-8559-8c20529dd333 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:06.108508 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46f7da43-e44b-4a23-8559-8c20529dd333 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:06.108930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46f7da43-e44b-4a23-8559-8c20529dd333 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:06.110667 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46f7da43-e44b-4a23-8559-8c20529dd333 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:06.110667 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46f7da43-e44b-4a23-8559-8c20529dd333 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:06.110667 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46f7da43-e44b-4a23-8559-8c20529dd333 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:06.140198 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-46f7da43-e44b-4a23-8559-8c20529dd333 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045343 Aug 18 12:25:06.140832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 275/557] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:25:06 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 12:25:06.213612 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-53313cd0-cd75-43a6-84b4-d9584ee2b55e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:06.214110 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-53313cd0-cd75-43a6-84b4-d9584ee2b55e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:06.220234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-53313cd0-cd75-43a6-84b4-d9584ee2b55e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:06.220718 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-53313cd0-cd75-43a6-84b4-d9584ee2b55e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:06.221181 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-53313cd0-cd75-43a6-84b4-d9584ee2b55e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:06.221867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-53313cd0-cd75-43a6-84b4-d9584ee2b55e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:06.222317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-53313cd0-cd75-43a6-84b4-d9584ee2b55e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:06.222735 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-53313cd0-cd75-43a6-84b4-d9584ee2b55e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:06.248308 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-53313cd0-cd75-43a6-84b4-d9584ee2b55e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:25:06.274389 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=100 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:06.614015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-53313cd0-cd75-43a6-84b4-d9584ee2b55e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "DELETE /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 204 len: 0 microversion: 2.1 time: 0.403885 Aug 18 12:25:06.614609 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 283/558] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:25:06 2022] DELETE /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:25:06.623655 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6e878efd-adaa-4e9a-8ca0-3e230fe94e2c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:06.624488 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-6e878efd-adaa-4e9a-8ca0-3e230fe94e2c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:06.630457 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e878efd-adaa-4e9a-8ca0-3e230fe94e2c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:06.630952 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e878efd-adaa-4e9a-8ca0-3e230fe94e2c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:06.631391 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e878efd-adaa-4e9a-8ca0-3e230fe94e2c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:06.632111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e878efd-adaa-4e9a-8ca0-3e230fe94e2c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:06.632565 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e878efd-adaa-4e9a-8ca0-3e230fe94e2c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:06.632993 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e878efd-adaa-4e9a-8ca0-3e230fe94e2c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:06.767403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6e878efd-adaa-4e9a-8ca0-3e230fe94e2c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:06.775677 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6e878efd-adaa-4e9a-8ca0-3e230fe94e2c tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1672 microversion: 2.1 time: 0.155818 Aug 18 12:25:06.776184 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 276/559] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:06 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:07.039097 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:07.039908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:07.046668 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:07.047213 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:07.047678 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:07.048383 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:07.048842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:07.049264 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:07.185956 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:07.194407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:07.196507 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:07.197673 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5dbd0c83-6a35-4e40-9a72-fd63a13be4ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.163287 Aug 18 12:25:07.198228 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 284/560] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:07 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:07.796605 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-222e1323-94fc-40c4-902c-f8bc9b149f04 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:07.797215 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-222e1323-94fc-40c4-902c-f8bc9b149f04 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:07.803745 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-222e1323-94fc-40c4-902c-f8bc9b149f04 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:07.804225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-222e1323-94fc-40c4-902c-f8bc9b149f04 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:07.804664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-222e1323-94fc-40c4-902c-f8bc9b149f04 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:07.805360 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-222e1323-94fc-40c4-902c-f8bc9b149f04 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:07.805813 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-222e1323-94fc-40c4-902c-f8bc9b149f04 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:07.806240 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-222e1323-94fc-40c4-902c-f8bc9b149f04 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:07.941264 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-222e1323-94fc-40c4-902c-f8bc9b149f04 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:07.949230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-222e1323-94fc-40c4-902c-f8bc9b149f04 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1672 microversion: 2.1 time: 0.156385 Aug 18 12:25:07.949839 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 277/561] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:07 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:08.220588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:08.221200 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:08.227775 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:08.228266 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:08.228700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:08.229388 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:08.229837 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:08.230258 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:08.361769 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:08.370409 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:08.371949 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:08.373098 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cbfa5c84-9f5b-4e98-9ef2-69a9e14d1588 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.156355 Aug 18 12:25:08.373707 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 285/562] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:08 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:08.971187 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-81b57c1e-e09c-46e7-a9b4-cff8ca5dc61d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:08.971847 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-81b57c1e-e09c-46e7-a9b4-cff8ca5dc61d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:08.978231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-81b57c1e-e09c-46e7-a9b4-cff8ca5dc61d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:08.978709 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-81b57c1e-e09c-46e7-a9b4-cff8ca5dc61d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:08.979680 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-81b57c1e-e09c-46e7-a9b4-cff8ca5dc61d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:08.980375 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-81b57c1e-e09c-46e7-a9b4-cff8ca5dc61d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:08.980829 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-81b57c1e-e09c-46e7-a9b4-cff8ca5dc61d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:08.981248 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-81b57c1e-e09c-46e7-a9b4-cff8ca5dc61d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:09.110714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-81b57c1e-e09c-46e7-a9b4-cff8ca5dc61d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:09.118478 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-81b57c1e-e09c-46e7-a9b4-cff8ca5dc61d tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1672 microversion: 2.1 time: 0.151180 Aug 18 12:25:09.119040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 278/563] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:08 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:09.396698 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:09.397277 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:09.404463 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:09.404946 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:09.405381 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:09.406072 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:09.406524 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:09.406944 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:09.539926 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:09.549045 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:09.550557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:09.551736 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-418c96c8-8e49-465a-908a-d02aab99e7fb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.159325 Aug 18 12:25:09.552299 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 286/564] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:09 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:10.140700 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5ed6701a-a042-48a3-b92e-8ef620e78cc0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:10.141319 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5ed6701a-a042-48a3-b92e-8ef620e78cc0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:10.147891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5ed6701a-a042-48a3-b92e-8ef620e78cc0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:10.150588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5ed6701a-a042-48a3-b92e-8ef620e78cc0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:10.150588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5ed6701a-a042-48a3-b92e-8ef620e78cc0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:10.150588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5ed6701a-a042-48a3-b92e-8ef620e78cc0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:10.150588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5ed6701a-a042-48a3-b92e-8ef620e78cc0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:10.150969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5ed6701a-a042-48a3-b92e-8ef620e78cc0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:10.397279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5ed6701a-a042-48a3-b92e-8ef620e78cc0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:10.406162 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5ed6701a-a042-48a3-b92e-8ef620e78cc0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1672 microversion: 2.1 time: 0.269295 Aug 18 12:25:10.408468 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 279/565] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:10 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1672 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:10.574905 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:10.576558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:10.589234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:10.589735 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:10.590173 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:10.591024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:10.591511 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:10.591934 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:10.598424 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-afc985d3-683d-4580-bad6-61fcdd23f43c req-6a034fe5-6e62-4297-8548-d5c68494f234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316b26d0-6178-4b02-8207-e910af024af2", "name": "network-vif-deleted", "tag": "b8ccdcb7-b2f1-4bf6-ad93-0a6747cda292"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:10.610041 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-afc985d3-683d-4580-bad6-61fcdd23f43c req-6a034fe5-6e62-4297-8548-d5c68494f234 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:10.610609 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-afc985d3-683d-4580-bad6-61fcdd23f43c req-6a034fe5-6e62-4297-8548-d5c68494f234 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:10.611442 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-afc985d3-683d-4580-bad6-61fcdd23f43c req-6a034fe5-6e62-4297-8548-d5c68494f234 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:10.623717 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-afc985d3-683d-4580-bad6-61fcdd23f43c req-6a034fe5-6e62-4297-8548-d5c68494f234 service nova] Creating event network-vif-deleted:b8ccdcb7-b2f1-4bf6-ad93-0a6747cda292 for instance 316b26d0-6178-4b02-8207-e910af024af2 on hv-cinder-83602 Aug 18 12:25:10.629815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-afc985d3-683d-4580-bad6-61fcdd23f43c req-6a034fe5-6e62-4297-8548-d5c68494f234 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040458 Aug 18 12:25:10.631179 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 280/566] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:25:10.761290 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:10.770951 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:10.772480 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:10.773647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fe739b05-fe78-48fa-bd75-c1258c5d6f82 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.202698 Aug 18 12:25:10.774204 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 287/567] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:10 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:11.429098 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:11.430210 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:11.440232 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:11.440690 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:11.441637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:11.442363 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:11.442826 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:11.443256 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:11.483743 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:11.485215 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:11.486139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:11.496020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lazy-loading 'fault' on Instance uuid 316b26d0-6178-4b02-8207-e910af024af2 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:25:11.560319 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:11.574671 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-bbedc334-969e-455f-90db-9a2e58049721 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 200 len: 1325 microversion: 2.1 time: 0.150201 Aug 18 12:25:11.575496 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 281/568] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:11 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 1325 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:11.803091 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:11.804667 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:11.811040 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:11.812222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:11.812651 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:11.813341 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:11.813819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:11.814265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:11.945281 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:11.954037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:11.955552 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:11.956876 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c0d94d6f-8f17-4d98-a538-76a641edb379 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.157835 Aug 18 12:25:11.957595 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 288/569] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:11 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:12.596348 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:12.597106 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:12.604089 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:12.604576 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:12.605024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:12.605847 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:12.606296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:12.606713 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:12.623308 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] HTTP exception thrown: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Request method failure captured: Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 HTTP/1.1 Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i6PVoJY4FFDXrcZklUWOhErg8RtBjjU4Fh-5HwhqH6epf4KEfErOpYqVUjcwmrcVzhmP2lmkzPT_CvnOHsZCFZscHbgPOoWqRRHkjYdYKEZ7MyXPcMsEwEaRfP08iiY-YIxPaOXeJ7Nd6Iwsi_jmHJ7CK39lFFMEl3irHGFEZgwJcM Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:25:12.625292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: b5113b1a77fd4b5da175b29b40d2b636 Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:25:12.626947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '316b26d0-6178-4b02-8207-e910af024af2'} Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:25:12.628539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:25:12.630091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:12.631664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Returning 404 to user: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:25:12.631664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5b7807bd-1346-4566-9407-a82c8040f994 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 404 len: 111 microversion: 2.1 time: 0.034516 Aug 18 12:25:12.631664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 282/570] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:12 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:25:12.637219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-505916e8-8173-4bd4-8a12-b5043d657df3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '.version_select at 0x7f3794021310>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:12.718045 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-505916e8-8173-4bd4-8a12-b5043d657df3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559355034" status: 202 len: 0 microversion: 2.1 time: 0.085436 Aug 18 12:25:12.718657 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 289/571] 10.222.0.98 () {58 vars in 1218 bytes} [Thu Aug 18 12:25:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559355034 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:25:12.983548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:12.983822 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:12.991305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:12.992113 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:12.992551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:12.993258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:12.993714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:12.994340 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:13.109034 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-89fbeea9-d083-4bda-b07d-70d138bd5bf8 req-44257f28-1f90-4900-9521-95fc6555d509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4dfc92-fb5b-46f3-a14a-992de65d7adb", "name": "network-vif-plugged", "status": "completed", "tag": "45eda560-60cf-411c-954a-1838984f4e8f"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:13.118257 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-89fbeea9-d083-4bda-b07d-70d138bd5bf8 req-44257f28-1f90-4900-9521-95fc6555d509 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:13.118737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-89fbeea9-d083-4bda-b07d-70d138bd5bf8 req-44257f28-1f90-4900-9521-95fc6555d509 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:13.119174 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-89fbeea9-d083-4bda-b07d-70d138bd5bf8 req-44257f28-1f90-4900-9521-95fc6555d509 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:13.131122 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-89fbeea9-d083-4bda-b07d-70d138bd5bf8 req-44257f28-1f90-4900-9521-95fc6555d509 service nova] Creating event network-vif-plugged:45eda560-60cf-411c-954a-1838984f4e8f for instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb on hv-cinder-83602 Aug 18 12:25:13.137558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-89fbeea9-d083-4bda-b07d-70d138bd5bf8 req-44257f28-1f90-4900-9521-95fc6555d509 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035842 Aug 18 12:25:13.137558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 290/572] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:25:13.217205 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:13.226427 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:13.227969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:13.230735 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-52473326-ab45-41e6-8b27-536b1ad83131 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.254171 Aug 18 12:25:13.231821 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 283/573] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:12 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:13.563811 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e4772532-5036-438f-92a4-2db6380e8908 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Action: 'create', calling method: .version_select at 0x7f3787fc6ca0>, body: {"keypair": {"name": "tempest-keypair-2084712204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJsz2itesCpsq/6ZHJ3OlVROpSnkYuNxOHadb8I3SNBTsfxwn9tDKxPlXqmD8q4qL7AFg5QttVNUZvyz8pPtIlVXVawYdFSo/Ot8gDkrqUGFTBFyp0BdJHaJxxJdplRVQ=="}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:13.580495 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-e4772532-5036-438f-92a4-2db6380e8908 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Getting quotas for project b1f3e22eb01045f299926f67cd36b91d. Resources: {'key_pairs'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:25:13.584468 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-e4772532-5036-438f-92a4-2db6380e8908 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Getting quotas for user b5113b1a77fd4b5da175b29b40d2b636 and project b1f3e22eb01045f299926f67cd36b91d. Resources: {'key_pairs'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:25:13.689158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e4772532-5036-438f-92a4-2db6380e8908 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129595 Aug 18 12:25:13.689869 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 291/574] 10.222.0.98 () {60 vars in 1159 bytes} [Thu Aug 18 12:25:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:14.254269 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:14.254896 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:14.261580 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:14.262117 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:14.262559 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:14.263267 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:14.263753 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:14.264181 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:14.422185 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:14.430977 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:14.432550 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:14.433919 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e285f3f7-18c3-4021-b8d2-fb2a22f337eb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.183820 Aug 18 12:25:14.434486 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 284/575] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:14 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:15.460479 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:15.461308 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:15.469293 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:15.469812 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:15.470306 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:15.471371 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:15.471939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:15.472436 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:15.617314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:15.626172 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:15.627826 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:15.629086 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-982487a9-8747-4b7c-a654-69ed7f5fed25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1807 microversion: 2.20 time: 0.173149 Aug 18 12:25:15.636013 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 292/576] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:15 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:15.930665 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-696980405", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4609452-41da-45f9-867e-856dd6365cd4"}], "security_groups": [{"name": "tempest-securitygroup--1945237811"}], "key_name": "tempest-keypair-2084712204", "user_data": "}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:16.041737 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] validate_networks() for [('c4609452-41da-45f9-867e-856dd6365cd4', None, None, None, None, None)] {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:25:16.653962 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:16.655575 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:16.661898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:16.662426 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:16.663027 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:16.663611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:16.664049 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:16.664466 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:16.675057 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:25:16.675517 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:25:16.675995 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:25:16.676430 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:25:16.676861 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:25:16.686060 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:16.686543 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:16.686978 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:16.687729 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:16.688180 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:16.688602 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:16.706199 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Getting quotas for project b1f3e22eb01045f299926f67cd36b91d. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:25:16.710276 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Getting quotas for user b5113b1a77fd4b5da175b29b40d2b636 and project b1f3e22eb01045f299926f67cd36b91d. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:25:16.722133 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:25:16.724409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:25:16.805842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:16.815032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:16.816552 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:16.817697 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cf508070-099f-40fe-89da-4bf62a80ee93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1794 microversion: 2.20 time: 0.169036 Aug 18 12:25:16.818250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 293/577] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:16 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1794 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:25:16.872936 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e799b839-5001-441d-bfde-b825d3176f37 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.946429 Aug 18 12:25:16.873602 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 285/578] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:25:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:25:16.884427 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d5d7b207-deff-4647-be21-e8b7805ff8dc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:16.885700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d5d7b207-deff-4647-be21-e8b7805ff8dc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:16.938995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d5d7b207-deff-4647-be21-e8b7805ff8dc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:16.945839 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d5d7b207-deff-4647-be21-e8b7805ff8dc tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1237 microversion: 2.1 time: 0.065261 Aug 18 12:25:16.946420 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 294/579] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:16 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:17.967600 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-25a93c90-4138-4de7-b154-75ee55561d3a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:17.968182 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-25a93c90-4138-4de7-b154-75ee55561d3a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:17.976121 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25a93c90-4138-4de7-b154-75ee55561d3a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:17.976614 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25a93c90-4138-4de7-b154-75ee55561d3a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:17.977237 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25a93c90-4138-4de7-b154-75ee55561d3a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:17.977966 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25a93c90-4138-4de7-b154-75ee55561d3a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:17.978416 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25a93c90-4138-4de7-b154-75ee55561d3a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:17.978830 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25a93c90-4138-4de7-b154-75ee55561d3a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:18.055365 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-25a93c90-4138-4de7-b154-75ee55561d3a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:18.065059 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-25a93c90-4138-4de7-b154-75ee55561d3a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1241 microversion: 2.1 time: 0.102389 Aug 18 12:25:18.065678 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 286/580] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:17 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:19.086502 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-45a7f696-9035-4fbd-94ca-011d1f9ae627 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:19.088601 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-45a7f696-9035-4fbd-94ca-011d1f9ae627 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:19.096351 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-45a7f696-9035-4fbd-94ca-011d1f9ae627 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:19.097680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-45a7f696-9035-4fbd-94ca-011d1f9ae627 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:19.098211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-45a7f696-9035-4fbd-94ca-011d1f9ae627 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:19.099201 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-45a7f696-9035-4fbd-94ca-011d1f9ae627 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:19.099902 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-45a7f696-9035-4fbd-94ca-011d1f9ae627 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:19.100560 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-45a7f696-9035-4fbd-94ca-011d1f9ae627 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:19.177963 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-45a7f696-9035-4fbd-94ca-011d1f9ae627 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:19.187292 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-45a7f696-9035-4fbd-94ca-011d1f9ae627 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1297 microversion: 2.1 time: 0.105133 Aug 18 12:25:19.189236 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 295/581] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:19 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:20.211387 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c3bdcad4-f2bc-4b50-bdd5-1ce630dff720 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:20.212011 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c3bdcad4-f2bc-4b50-bdd5-1ce630dff720 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:20.219213 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bdcad4-f2bc-4b50-bdd5-1ce630dff720 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:20.219738 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bdcad4-f2bc-4b50-bdd5-1ce630dff720 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:20.220170 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bdcad4-f2bc-4b50-bdd5-1ce630dff720 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:20.220867 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bdcad4-f2bc-4b50-bdd5-1ce630dff720 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:20.221313 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bdcad4-f2bc-4b50-bdd5-1ce630dff720 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:20.221737 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c3bdcad4-f2bc-4b50-bdd5-1ce630dff720 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:20.632781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c3bdcad4-f2bc-4b50-bdd5-1ce630dff720 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:20.640367 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c3bdcad4-f2bc-4b50-bdd5-1ce630dff720 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1363 microversion: 2.1 time: 0.432701 Aug 18 12:25:20.640839 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 287/582] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:20 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1363 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:20.802259 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-a36825a7-4528-4d61-880c-932a3c244fa5 req-aefcdeae-e6b9-40ed-85c4-efa462483d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b330121b-dab2-4dbd-bf91-b0fd44ffcb84", "tag": "7a83416b-9bd1-4e3d-bc38-21475e6e5859"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:20.812500 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-a36825a7-4528-4d61-880c-932a3c244fa5 req-aefcdeae-e6b9-40ed-85c4-efa462483d8d service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:20.812983 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-a36825a7-4528-4d61-880c-932a3c244fa5 req-aefcdeae-e6b9-40ed-85c4-efa462483d8d service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:20.813414 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-a36825a7-4528-4d61-880c-932a3c244fa5 req-aefcdeae-e6b9-40ed-85c4-efa462483d8d service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:20.825588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-a36825a7-4528-4d61-880c-932a3c244fa5 req-aefcdeae-e6b9-40ed-85c4-efa462483d8d service nova] Creating event network-changed:7a83416b-9bd1-4e3d-bc38-21475e6e5859 for instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 on hv-cinder-83602 Aug 18 12:25:20.831085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-a36825a7-4528-4d61-880c-932a3c244fa5 req-aefcdeae-e6b9-40ed-85c4-efa462483d8d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032642 Aug 18 12:25:20.831762 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 296/583] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:21.661879 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ac1a189c-52ed-4491-825a-2bc05de45545 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:21.662498 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ac1a189c-52ed-4491-825a-2bc05de45545 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:21.669114 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac1a189c-52ed-4491-825a-2bc05de45545 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:21.669594 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac1a189c-52ed-4491-825a-2bc05de45545 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:21.670020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac1a189c-52ed-4491-825a-2bc05de45545 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:21.670704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac1a189c-52ed-4491-825a-2bc05de45545 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:21.671152 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac1a189c-52ed-4491-825a-2bc05de45545 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:21.671597 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ac1a189c-52ed-4491-825a-2bc05de45545 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:21.802071 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ac1a189c-52ed-4491-825a-2bc05de45545 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:21.809395 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ac1a189c-52ed-4491-825a-2bc05de45545 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1363 microversion: 2.1 time: 0.151342 Aug 18 12:25:21.809955 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 288/584] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:21 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:22.831274 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-488f3e80-5b2f-433c-ba01-debdc380c7ee tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:22.831919 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-488f3e80-5b2f-433c-ba01-debdc380c7ee tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:22.833883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:22.838836 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-488f3e80-5b2f-433c-ba01-debdc380c7ee tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:22.839315 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-488f3e80-5b2f-433c-ba01-debdc380c7ee tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:22.839776 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-488f3e80-5b2f-433c-ba01-debdc380c7ee tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:22.840470 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-488f3e80-5b2f-433c-ba01-debdc380c7ee tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:22.840923 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-488f3e80-5b2f-433c-ba01-debdc380c7ee tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:22.841344 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-488f3e80-5b2f-433c-ba01-debdc380c7ee tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:23.028064 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-488f3e80-5b2f-433c-ba01-debdc380c7ee tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:23.035504 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-488f3e80-5b2f-433c-ba01-debdc380c7ee tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1363 microversion: 2.1 time: 0.208996 Aug 18 12:25:23.036065 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 297/585] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:22 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:24.056693 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-82129a9f-cb2d-4447-b855-b7abe299ff97 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:24.084653 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-82129a9f-cb2d-4447-b855-b7abe299ff97 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:24.084653 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-82129a9f-cb2d-4447-b855-b7abe299ff97 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:24.084653 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-82129a9f-cb2d-4447-b855-b7abe299ff97 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:24.084653 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-82129a9f-cb2d-4447-b855-b7abe299ff97 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:24.085074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-82129a9f-cb2d-4447-b855-b7abe299ff97 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:24.085074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-82129a9f-cb2d-4447-b855-b7abe299ff97 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:24.085074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-82129a9f-cb2d-4447-b855-b7abe299ff97 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:24.194899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-82129a9f-cb2d-4447-b855-b7abe299ff97 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:24.203097 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-82129a9f-cb2d-4447-b855-b7abe299ff97 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1363 microversion: 2.1 time: 0.150366 Aug 18 12:25:24.203701 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 289/586] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:24 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:24.663378 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ae3dbac7-43fa-4e65-945e-cde53aa5c97d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-524478662"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:24.664001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ae3dbac7-43fa-4e65-945e-cde53aa5c97d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:24.671495 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae3dbac7-43fa-4e65-945e-cde53aa5c97d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:24.671981 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae3dbac7-43fa-4e65-945e-cde53aa5c97d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:24.672407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae3dbac7-43fa-4e65-945e-cde53aa5c97d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:24.673151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae3dbac7-43fa-4e65-945e-cde53aa5c97d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:24.673597 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae3dbac7-43fa-4e65-945e-cde53aa5c97d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:24.674011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ae3dbac7-43fa-4e65-945e-cde53aa5c97d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:24.803640 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.network.security_group_api [None req-ae3dbac7-43fa-4e65-945e-cde53aa5c97d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Removing security group e52b3afa-dbd7-4010-9cc9-589944e68595 from port 1056879d-4dc9-4cb8-a5a7-372ccbc78813 Aug 18 12:25:25.204316 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ae3dbac7-43fa-4e65-945e-cde53aa5c97d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "POST /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/action" status: 202 len: 0 microversion: 2.1 time: 0.544832 Aug 18 12:25:25.204947 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 298/587] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:25:24 2022] POST /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:25:25.215791 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-1c44a9ba-98b7-4619-83cf-de4a184dae64 req-e31edc6a-b074-4285-b26f-549d1b699198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327172e2-b2a2-479d-89f8-1810071e75ab", "tag": "1056879d-4dc9-4cb8-a5a7-372ccbc78813"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:25.224787 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4fb8286a-f096-40e1-b0ae-14f4a9d26aa0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:25.225565 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-4fb8286a-f096-40e1-b0ae-14f4a9d26aa0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:25.233994 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:25.238510 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4fb8286a-f096-40e1-b0ae-14f4a9d26aa0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:25.239001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4fb8286a-f096-40e1-b0ae-14f4a9d26aa0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:25.239468 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4fb8286a-f096-40e1-b0ae-14f4a9d26aa0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:25.247446 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4fb8286a-f096-40e1-b0ae-14f4a9d26aa0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:25.247446 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4fb8286a-f096-40e1-b0ae-14f4a9d26aa0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:25.247446 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4fb8286a-f096-40e1-b0ae-14f4a9d26aa0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:25.249621 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-1c44a9ba-98b7-4619-83cf-de4a184dae64 req-e31edc6a-b074-4285-b26f-549d1b699198 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:25.250695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-1c44a9ba-98b7-4619-83cf-de4a184dae64 req-e31edc6a-b074-4285-b26f-549d1b699198 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:25.251305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-1c44a9ba-98b7-4619-83cf-de4a184dae64 req-e31edc6a-b074-4285-b26f-549d1b699198 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:25.255723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=100 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:25.275678 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-1c44a9ba-98b7-4619-83cf-de4a184dae64 req-e31edc6a-b074-4285-b26f-549d1b699198 service nova] Creating event network-changed:1056879d-4dc9-4cb8-a5a7-372ccbc78813 for instance 327172e2-b2a2-479d-89f8-1810071e75ab on hv-cinder-83602 Aug 18 12:25:25.291863 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-1c44a9ba-98b7-4619-83cf-de4a184dae64 req-e31edc6a-b074-4285-b26f-549d1b699198 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079907 Aug 18 12:25:25.294392 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 290/588] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:25.443657 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-4fb8286a-f096-40e1-b0ae-14f4a9d26aa0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:25.454630 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4fb8286a-f096-40e1-b0ae-14f4a9d26aa0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1363 microversion: 2.1 time: 0.233957 Aug 18 12:25:25.455618 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 299/589] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:25 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:26.478244 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6dc045e8-6e02-4a46-ab2d-8740381065f3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:26.479038 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-6dc045e8-6e02-4a46-ab2d-8740381065f3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:26.486637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6dc045e8-6e02-4a46-ab2d-8740381065f3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:26.487138 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6dc045e8-6e02-4a46-ab2d-8740381065f3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:26.487595 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6dc045e8-6e02-4a46-ab2d-8740381065f3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:26.488283 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6dc045e8-6e02-4a46-ab2d-8740381065f3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:26.488724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6dc045e8-6e02-4a46-ab2d-8740381065f3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:26.489139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6dc045e8-6e02-4a46-ab2d-8740381065f3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:26.562420 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-411ad7c9-e050-404b-bfd5-b0f4b671c540 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:26.562420 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-411ad7c9-e050-404b-bfd5-b0f4b671c540 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:26.563902 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-411ad7c9-e050-404b-bfd5-b0f4b671c540 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:26.564460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-411ad7c9-e050-404b-bfd5-b0f4b671c540 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:26.565146 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-411ad7c9-e050-404b-bfd5-b0f4b671c540 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:26.565966 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-411ad7c9-e050-404b-bfd5-b0f4b671c540 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:26.566503 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-411ad7c9-e050-404b-bfd5-b0f4b671c540 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:26.567151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-411ad7c9-e050-404b-bfd5-b0f4b671c540 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:26.627277 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6dc045e8-6e02-4a46-ab2d-8740381065f3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:26.641715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6dc045e8-6e02-4a46-ab2d-8740381065f3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1363 microversion: 2.1 time: 0.168711 Aug 18 12:25:26.642305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 291/590] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:26 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:26.660398 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-411ad7c9-e050-404b-bfd5-b0f4b671c540 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lazy-loading 'services' on Instance uuid 327172e2-b2a2-479d-89f8-1810071e75ab {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:25:26.865095 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-411ad7c9-e050-404b-bfd5-b0f4b671c540 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "DELETE /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments/9ab1abe6-9528-413f-ab81-039a920343d3" status: 202 len: 0 microversion: 2.1 time: 0.313346 Aug 18 12:25:26.870251 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 300/591] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:25:26 2022] DELETE /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments/9ab1abe6-9528-413f-ab81-039a920343d3 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:25:26.875496 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f5aa117a-a6fc-41c5-bedb-881f5df37189 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:26.877781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f5aa117a-a6fc-41c5-bedb-881f5df37189 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:26.880047 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:26.880723 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=6 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:26.885583 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5aa117a-a6fc-41c5-bedb-881f5df37189 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:26.886078 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5aa117a-a6fc-41c5-bedb-881f5df37189 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:26.886537 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5aa117a-a6fc-41c5-bedb-881f5df37189 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:26.887240 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5aa117a-a6fc-41c5-bedb-881f5df37189 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:26.887784 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5aa117a-a6fc-41c5-bedb-881f5df37189 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:26.888165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5aa117a-a6fc-41c5-bedb-881f5df37189 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:26.918031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f5aa117a-a6fc-41c5-bedb-881f5df37189 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047507 Aug 18 12:25:26.918602 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 292/592] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:25:26 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:27.224379 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-1176b42f-e8f8-4d3d-9976-0752b5ab254d req-f961d7e8-75fa-4b7c-a65b-2ede396dc9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b330121b-dab2-4dbd-bf91-b0fd44ffcb84", "name": "network-vif-plugged", "status": "completed", "tag": "7a83416b-9bd1-4e3d-bc38-21475e6e5859"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:27.231291 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=6 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:27.244979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-1176b42f-e8f8-4d3d-9976-0752b5ab254d req-f961d7e8-75fa-4b7c-a65b-2ede396dc9cb service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:27.245461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-1176b42f-e8f8-4d3d-9976-0752b5ab254d req-f961d7e8-75fa-4b7c-a65b-2ede396dc9cb service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:27.245882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-1176b42f-e8f8-4d3d-9976-0752b5ab254d req-f961d7e8-75fa-4b7c-a65b-2ede396dc9cb service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:27.258597 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-1176b42f-e8f8-4d3d-9976-0752b5ab254d req-f961d7e8-75fa-4b7c-a65b-2ede396dc9cb service nova] Creating event network-vif-plugged:7a83416b-9bd1-4e3d-bc38-21475e6e5859 for instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 on hv-cinder-83602 Aug 18 12:25:27.263474 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-1176b42f-e8f8-4d3d-9976-0752b5ab254d req-f961d7e8-75fa-4b7c-a65b-2ede396dc9cb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043723 Aug 18 12:25:27.264667 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 301/593] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:27.308924 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-82954c48-98fa-4b16-a3b9-a0a6b5652fbf req-87c1caa5-3230-4c7f-83c6-ec7c6ccb2c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327172e2-b2a2-479d-89f8-1810071e75ab", "tag": "1056879d-4dc9-4cb8-a5a7-372ccbc78813"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:27.320193 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-82954c48-98fa-4b16-a3b9-a0a6b5652fbf req-87c1caa5-3230-4c7f-83c6-ec7c6ccb2c61 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:27.320678 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-82954c48-98fa-4b16-a3b9-a0a6b5652fbf req-87c1caa5-3230-4c7f-83c6-ec7c6ccb2c61 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:27.321117 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-82954c48-98fa-4b16-a3b9-a0a6b5652fbf req-87c1caa5-3230-4c7f-83c6-ec7c6ccb2c61 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:27.333948 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-82954c48-98fa-4b16-a3b9-a0a6b5652fbf req-87c1caa5-3230-4c7f-83c6-ec7c6ccb2c61 service nova] Creating event network-changed:1056879d-4dc9-4cb8-a5a7-372ccbc78813 for instance 327172e2-b2a2-479d-89f8-1810071e75ab on hv-cinder-83602 Aug 18 12:25:27.340388 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-82954c48-98fa-4b16-a3b9-a0a6b5652fbf req-87c1caa5-3230-4c7f-83c6-ec7c6ccb2c61 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034925 Aug 18 12:25:27.340993 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 293/594] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:27.665014 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5b4abc2a-8a74-41fd-909c-9147c8fcc584 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:27.665823 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5b4abc2a-8a74-41fd-909c-9147c8fcc584 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:27.677608 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b4abc2a-8a74-41fd-909c-9147c8fcc584 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:27.678298 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b4abc2a-8a74-41fd-909c-9147c8fcc584 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:27.678855 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b4abc2a-8a74-41fd-909c-9147c8fcc584 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:27.679712 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b4abc2a-8a74-41fd-909c-9147c8fcc584 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:27.680509 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b4abc2a-8a74-41fd-909c-9147c8fcc584 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:27.681053 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b4abc2a-8a74-41fd-909c-9147c8fcc584 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:27.830852 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5b4abc2a-8a74-41fd-909c-9147c8fcc584 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:27.839144 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5b4abc2a-8a74-41fd-909c-9147c8fcc584 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1363 microversion: 2.1 time: 0.178652 Aug 18 12:25:27.840688 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 302/595] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:27 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:27.931361 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5da99e73-62bc-4ff8-97f7-200d83d2fdb4 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:27.934126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5da99e73-62bc-4ff8-97f7-200d83d2fdb4 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:27.940858 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5da99e73-62bc-4ff8-97f7-200d83d2fdb4 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:27.941359 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5da99e73-62bc-4ff8-97f7-200d83d2fdb4 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:27.941830 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5da99e73-62bc-4ff8-97f7-200d83d2fdb4 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:27.942597 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5da99e73-62bc-4ff8-97f7-200d83d2fdb4 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:27.943227 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5da99e73-62bc-4ff8-97f7-200d83d2fdb4 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:27.944061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5da99e73-62bc-4ff8-97f7-200d83d2fdb4 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:27.973596 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5da99e73-62bc-4ff8-97f7-200d83d2fdb4 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047058 Aug 18 12:25:27.974150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 294/596] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:25:27 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:28.603983 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e26f2ea8-796e-473e-9caf-2e25a916fdab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:28.604393 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e26f2ea8-796e-473e-9caf-2e25a916fdab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:28.610566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e26f2ea8-796e-473e-9caf-2e25a916fdab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:28.611045 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e26f2ea8-796e-473e-9caf-2e25a916fdab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:28.611510 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e26f2ea8-796e-473e-9caf-2e25a916fdab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:28.612191 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e26f2ea8-796e-473e-9caf-2e25a916fdab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:28.612642 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e26f2ea8-796e-473e-9caf-2e25a916fdab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:28.613061 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e26f2ea8-796e-473e-9caf-2e25a916fdab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:28.694935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-e26f2ea8-796e-473e-9caf-2e25a916fdab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lazy-loading 'services' on Instance uuid e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:25:28.698601 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:28.863447 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-bb724bf5-0067-42f1-80a0-e614e28dcb81 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:28.864075 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-bb724bf5-0067-42f1-80a0-e614e28dcb81 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:28.870979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bb724bf5-0067-42f1-80a0-e614e28dcb81 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:28.871674 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bb724bf5-0067-42f1-80a0-e614e28dcb81 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:28.872130 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bb724bf5-0067-42f1-80a0-e614e28dcb81 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:28.872855 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bb724bf5-0067-42f1-80a0-e614e28dcb81 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:28.873363 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bb724bf5-0067-42f1-80a0-e614e28dcb81 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:28.873793 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bb724bf5-0067-42f1-80a0-e614e28dcb81 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:28.933611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e26f2ea8-796e-473e-9caf-2e25a916fdab tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments/b505ffc5-b0df-4bba-a2c6-12559c7026a7" status: 202 len: 0 microversion: 2.1 time: 0.333466 Aug 18 12:25:28.935477 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 303/597] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:25:28 2022] DELETE /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments/b505ffc5-b0df-4bba-a2c6-12559c7026a7 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:25:28.944389 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-93e3559a-e7e9-4287-bc23-7a6d32df1587 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:28.947830 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-93e3559a-e7e9-4287-bc23-7a6d32df1587 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:28.956031 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93e3559a-e7e9-4287-bc23-7a6d32df1587 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:28.956666 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93e3559a-e7e9-4287-bc23-7a6d32df1587 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:28.957137 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93e3559a-e7e9-4287-bc23-7a6d32df1587 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:28.957833 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93e3559a-e7e9-4287-bc23-7a6d32df1587 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:28.958348 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93e3559a-e7e9-4287-bc23-7a6d32df1587 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:28.958826 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93e3559a-e7e9-4287-bc23-7a6d32df1587 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:28.996720 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-93e3559a-e7e9-4287-bc23-7a6d32df1587 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056750 Aug 18 12:25:28.997536 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 304/598] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:25:28 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:29.002282 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f92b32de-e836-4c84-9554-bdbbbf5b55a2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:29.012507 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f92b32de-e836-4c84-9554-bdbbbf5b55a2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:29.012507 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f92b32de-e836-4c84-9554-bdbbbf5b55a2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:29.012507 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f92b32de-e836-4c84-9554-bdbbbf5b55a2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:29.012507 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f92b32de-e836-4c84-9554-bdbbbf5b55a2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:29.013369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f92b32de-e836-4c84-9554-bdbbbf5b55a2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:29.013369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f92b32de-e836-4c84-9554-bdbbbf5b55a2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:29.013761 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f92b32de-e836-4c84-9554-bdbbbf5b55a2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:29.047127 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f92b32de-e836-4c84-9554-bdbbbf5b55a2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048535 Aug 18 12:25:29.047731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 305/599] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:25:28 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 12:25:29.057133 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bb724bf5-0067-42f1-80a0-e614e28dcb81 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:29.058671 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:29.059162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:29.065540 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-bb724bf5-0067-42f1-80a0-e614e28dcb81 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1363 microversion: 2.1 time: 0.206253 Aug 18 12:25:29.065810 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:29.066111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 295/600] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:28 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:29.066269 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:29.066774 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:29.067625 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:29.068075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:29.068496 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:29.144300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] HTTP exception thrown: Instance 327172e2-b2a2-479d-89f8-1810071e75ab is not attached to volume 9ab1abe6-9528-413f-ab81-039a920343d3 Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Request method failure captured: Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: DELETE /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments/9ab1abe6-9528-413f-ab81-039a920343d3 HTTP/1.1 Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i8Qx3OR8pg_dvzKkTY7YtpF7s4OhXyRmof6F3Tek06Rt5-bLssFLhgjin44YPvvsb97kVg0ZdoIFu8rLMyWYSIuNLvxpz0_Z7Di-Llgxsh5kTAZcboZPhHGzSGO1R3Ue8wHU6Fdl7JllfgPaHM68PjuNzs5OpBOgrHIg-wZdb-AqPE Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 944cd11144ca4cbf86962a3c9494ecbd Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-TestMinimumBasicScenario-1027604797 Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:25:29.146753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:25:29.148433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/944cd11144ca4cbf86962a3c9494ecbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/944cd11144ca4cbf86962a3c9494ecbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/944cd11144ca4cbf86962a3c9494ecbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_944cd11144ca4cbf86962a3c9494ecbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:25:29.148433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-TestMinimumBasicScenario-1027604797 Aug 18 12:25:29.148433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 944cd11144ca4cbf86962a3c9494ecbd Aug 18 12:25:29.148433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1027604797 Aug 18 12:25:29.148433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-TestMinimumBasicScenario-1027604797-project Aug 18 12:25:29.148433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:25:29.148433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:25:29.148433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: fcc7f1b599034654a3ed64dde2145bf8 Aug 18 12:25:29.148433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-TestMinimumBasicScenario-1027604797-project Aug 18 12:25:29.148433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:25:29.148433 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 327172e2-b2a2-479d-89f8-1810071e75ab is not attached to volume 9ab1abe6-9528-413f-ab81-039a920343d3 Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'server_id': '327172e2-b2a2-479d-89f8-1810071e75ab', 'id': '9ab1abe6-9528-413f-ab81-039a920343d3'} Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9ab1abe6-9528-413f-ab81-039a920343d3. Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:25:29.149336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 327172e2-b2a2-479d-89f8-1810071e75ab is not attached to volume 9ab1abe6-9528-413f-ab81-039a920343d3 Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 327172e2-b2a2-479d-89f8-1810071e75ab is not attached to volume 9ab1abe6-9528-413f-ab81-039a920343d3 Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:29.150819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Returning 404 to user: Instance 327172e2-b2a2-479d-89f8-1810071e75ab is not attached to volume 9ab1abe6-9528-413f-ab81-039a920343d3 {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:25:29.151976 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8275e685-e3a0-4e9e-a07a-71ba0eba2056 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "DELETE /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments/9ab1abe6-9528-413f-ab81-039a920343d3" status: 404 len: 154 microversion: 2.1 time: 0.093498 Aug 18 12:25:29.151976 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 306/601] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:25:29 2022] DELETE /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab/os-volume_attachments/9ab1abe6-9528-413f-ab81-039a920343d3 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:25:30.009234 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-1409fd7d-017b-4918-a2f3-634abb0b84c5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:30.011437 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-1409fd7d-017b-4918-a2f3-634abb0b84c5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:30.018117 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1409fd7d-017b-4918-a2f3-634abb0b84c5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.018603 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1409fd7d-017b-4918-a2f3-634abb0b84c5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.019050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1409fd7d-017b-4918-a2f3-634abb0b84c5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.019781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1409fd7d-017b-4918-a2f3-634abb0b84c5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.020237 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1409fd7d-017b-4918-a2f3-634abb0b84c5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.020666 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1409fd7d-017b-4918-a2f3-634abb0b84c5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.052026 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-1409fd7d-017b-4918-a2f3-634abb0b84c5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046733 Aug 18 12:25:30.052946 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 296/602] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:25:30 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:30.086115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3dde936b-d4c9-458a-8ee1-2bbb0d527565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:30.087738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3dde936b-d4c9-458a-8ee1-2bbb0d527565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:30.095306 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3dde936b-d4c9-458a-8ee1-2bbb0d527565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.095857 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3dde936b-d4c9-458a-8ee1-2bbb0d527565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.096300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3dde936b-d4c9-458a-8ee1-2bbb0d527565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.096998 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3dde936b-d4c9-458a-8ee1-2bbb0d527565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.097442 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3dde936b-d4c9-458a-8ee1-2bbb0d527565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.097864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3dde936b-d4c9-458a-8ee1-2bbb0d527565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.237357 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3dde936b-d4c9-458a-8ee1-2bbb0d527565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:30.244883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3dde936b-d4c9-458a-8ee1-2bbb0d527565 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1550 microversion: 2.1 time: 0.162684 Aug 18 12:25:30.245454 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 307/603] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:30 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:30.266619 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-39d7ac26-f2f2-43b6-b335-51c646dfa8fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:30.267179 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-39d7ac26-f2f2-43b6-b335-51c646dfa8fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:30.272950 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-39d7ac26-f2f2-43b6-b335-51c646dfa8fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.273434 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-39d7ac26-f2f2-43b6-b335-51c646dfa8fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.273868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-39d7ac26-f2f2-43b6-b335-51c646dfa8fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.274562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-39d7ac26-f2f2-43b6-b335-51c646dfa8fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.275019 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-39d7ac26-f2f2-43b6-b335-51c646dfa8fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.275465 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-39d7ac26-f2f2-43b6-b335-51c646dfa8fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.359586 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-39d7ac26-f2f2-43b6-b335-51c646dfa8fe tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097515 Aug 18 12:25:30.367465 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 297/604] 10.222.0.98 () {58 vars in 1275 bytes} [Thu Aug 18 12:25:30 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:25:30.444171 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cb9ce1d5-8a91-41d3-8d8e-0a34fe3888ee tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:30.444684 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-cb9ce1d5-8a91-41d3-8d8e-0a34fe3888ee tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:30.452104 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb9ce1d5-8a91-41d3-8d8e-0a34fe3888ee tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.452597 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb9ce1d5-8a91-41d3-8d8e-0a34fe3888ee tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.453033 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb9ce1d5-8a91-41d3-8d8e-0a34fe3888ee tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.453733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb9ce1d5-8a91-41d3-8d8e-0a34fe3888ee tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.454361 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb9ce1d5-8a91-41d3-8d8e-0a34fe3888ee tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.454944 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cb9ce1d5-8a91-41d3-8d8e-0a34fe3888ee tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.481209 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-cb9ce1d5-8a91-41d3-8d8e-0a34fe3888ee tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:25:30.789953 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cb9ce1d5-8a91-41d3-8d8e-0a34fe3888ee tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "DELETE /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 204 len: 0 microversion: 2.1 time: 0.349308 Aug 18 12:25:30.790581 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 308/605] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:25:30 2022] DELETE /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:25:30.799717 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c00bd537-75bb-4143-ab9d-0013836b8fa0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:30.800564 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c00bd537-75bb-4143-ab9d-0013836b8fa0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:30.806659 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c00bd537-75bb-4143-ab9d-0013836b8fa0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.807139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c00bd537-75bb-4143-ab9d-0013836b8fa0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.807617 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c00bd537-75bb-4143-ab9d-0013836b8fa0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.808406 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c00bd537-75bb-4143-ab9d-0013836b8fa0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.808860 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c00bd537-75bb-4143-ab9d-0013836b8fa0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.809283 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c00bd537-75bb-4143-ab9d-0013836b8fa0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.938390 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c00bd537-75bb-4143-ab9d-0013836b8fa0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:30.946124 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c00bd537-75bb-4143-ab9d-0013836b8fa0 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1554 microversion: 2.1 time: 0.150842 Aug 18 12:25:30.946729 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 298/606] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:30 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:31.065624 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d18fc42e-c7be-46fa-bb3c-8cfb5d3b204e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:31.067811 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d18fc42e-c7be-46fa-bb3c-8cfb5d3b204e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:31.073775 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d18fc42e-c7be-46fa-bb3c-8cfb5d3b204e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:31.074260 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d18fc42e-c7be-46fa-bb3c-8cfb5d3b204e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:31.074696 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d18fc42e-c7be-46fa-bb3c-8cfb5d3b204e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:31.075387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d18fc42e-c7be-46fa-bb3c-8cfb5d3b204e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:31.075864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d18fc42e-c7be-46fa-bb3c-8cfb5d3b204e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:31.076927 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d18fc42e-c7be-46fa-bb3c-8cfb5d3b204e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:31.106712 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d18fc42e-c7be-46fa-bb3c-8cfb5d3b204e tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045999 Aug 18 12:25:31.107393 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 309/607] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:25:31 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 12:25:31.190543 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-edccf12a-ff6e-4288-9bec-b8169d2f5bdf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:31.191040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-edccf12a-ff6e-4288-9bec-b8169d2f5bdf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:31.197556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edccf12a-ff6e-4288-9bec-b8169d2f5bdf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:31.198042 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edccf12a-ff6e-4288-9bec-b8169d2f5bdf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:31.198479 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edccf12a-ff6e-4288-9bec-b8169d2f5bdf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:31.199220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edccf12a-ff6e-4288-9bec-b8169d2f5bdf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:31.199697 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edccf12a-ff6e-4288-9bec-b8169d2f5bdf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:31.200125 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-edccf12a-ff6e-4288-9bec-b8169d2f5bdf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:31.227907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-edccf12a-ff6e-4288-9bec-b8169d2f5bdf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Going to try to terminate instance {{(pid=121244) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:25:31.364474 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-c1d4b2f8-3a99-478b-8669-e4a3d66abc72 req-b666824b-9b42-48e9-9367-e713c72dfd54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b330121b-dab2-4dbd-bf91-b0fd44ffcb84", "tag": "7a83416b-9bd1-4e3d-bc38-21475e6e5859"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:31.379870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-c1d4b2f8-3a99-478b-8669-e4a3d66abc72 req-b666824b-9b42-48e9-9367-e713c72dfd54 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:31.383312 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-c1d4b2f8-3a99-478b-8669-e4a3d66abc72 req-b666824b-9b42-48e9-9367-e713c72dfd54 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:31.383312 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-c1d4b2f8-3a99-478b-8669-e4a3d66abc72 req-b666824b-9b42-48e9-9367-e713c72dfd54 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:31.393727 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-c1d4b2f8-3a99-478b-8669-e4a3d66abc72 req-b666824b-9b42-48e9-9367-e713c72dfd54 service nova] Creating event network-changed:7a83416b-9bd1-4e3d-bc38-21475e6e5859 for instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 on hv-cinder-83602 Aug 18 12:25:31.399073 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-c1d4b2f8-3a99-478b-8669-e4a3d66abc72 req-b666824b-9b42-48e9-9367-e713c72dfd54 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038105 Aug 18 12:25:31.399693 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 310/608] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:25:31.510199 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-edccf12a-ff6e-4288-9bec-b8169d2f5bdf tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 204 len: 0 microversion: 2.1 time: 0.323706 Aug 18 12:25:31.510895 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 299/609] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:25:31 2022] DELETE /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:25:31.519675 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7431185d-c57d-4a99-a632-9a9e1bc8ccfe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:31.520505 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7431185d-c57d-4a99-a632-9a9e1bc8ccfe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:31.526980 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7431185d-c57d-4a99-a632-9a9e1bc8ccfe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:31.527561 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7431185d-c57d-4a99-a632-9a9e1bc8ccfe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:31.527995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7431185d-c57d-4a99-a632-9a9e1bc8ccfe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:31.528678 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7431185d-c57d-4a99-a632-9a9e1bc8ccfe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:31.529196 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7431185d-c57d-4a99-a632-9a9e1bc8ccfe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:31.529535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7431185d-c57d-4a99-a632-9a9e1bc8ccfe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:31.672530 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7431185d-c57d-4a99-a632-9a9e1bc8ccfe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:31.680499 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7431185d-c57d-4a99-a632-9a9e1bc8ccfe tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1689 microversion: 2.1 time: 0.165057 Aug 18 12:25:31.681093 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 311/610] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:31 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:31.969114 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-78a82b30-7f2b-4349-8ad5-4c1a5f6bb250 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:31.969968 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-78a82b30-7f2b-4349-8ad5-4c1a5f6bb250 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:31.976239 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-78a82b30-7f2b-4349-8ad5-4c1a5f6bb250 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:31.976724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-78a82b30-7f2b-4349-8ad5-4c1a5f6bb250 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:31.977174 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-78a82b30-7f2b-4349-8ad5-4c1a5f6bb250 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:31.977879 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-78a82b30-7f2b-4349-8ad5-4c1a5f6bb250 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:31.978512 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-78a82b30-7f2b-4349-8ad5-4c1a5f6bb250 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:31.979281 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-78a82b30-7f2b-4349-8ad5-4c1a5f6bb250 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:32.120633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-78a82b30-7f2b-4349-8ad5-4c1a5f6bb250 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:32.123356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:25:32.124624 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Thu Aug 18 12:25:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab (ip 10.222.0.98) !!! Aug 18 12:25:32.133309 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-78a82b30-7f2b-4349-8ad5-4c1a5f6bb250 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1554 microversion: 2.1 time: 0.169098 Aug 18 12:25:32.143979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 300/611] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:31 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:32.806252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b33713da-1115-46eb-b50a-0242789db7af tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:32.810411 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b33713da-1115-46eb-b50a-0242789db7af tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:32.813487 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b33713da-1115-46eb-b50a-0242789db7af tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:32.813969 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b33713da-1115-46eb-b50a-0242789db7af tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:32.814403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b33713da-1115-46eb-b50a-0242789db7af tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:32.815086 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b33713da-1115-46eb-b50a-0242789db7af tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:32.815584 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b33713da-1115-46eb-b50a-0242789db7af tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:32.816010 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b33713da-1115-46eb-b50a-0242789db7af tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:32.944301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b33713da-1115-46eb-b50a-0242789db7af tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:32.951978 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b33713da-1115-46eb-b50a-0242789db7af tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1689 microversion: 2.1 time: 0.254284 Aug 18 12:25:32.952725 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 312/612] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:32 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1689 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:33.155996 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-abbfc8b0-3514-49f5-9da6-f5a3bdd04dc2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:33.156543 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-abbfc8b0-3514-49f5-9da6-f5a3bdd04dc2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:33.162951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-abbfc8b0-3514-49f5-9da6-f5a3bdd04dc2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:33.163461 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-abbfc8b0-3514-49f5-9da6-f5a3bdd04dc2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:33.163900 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-abbfc8b0-3514-49f5-9da6-f5a3bdd04dc2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:33.164589 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-abbfc8b0-3514-49f5-9da6-f5a3bdd04dc2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:33.165040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-abbfc8b0-3514-49f5-9da6-f5a3bdd04dc2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:33.165463 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-abbfc8b0-3514-49f5-9da6-f5a3bdd04dc2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:33.296934 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-abbfc8b0-3514-49f5-9da6-f5a3bdd04dc2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:33.304668 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-abbfc8b0-3514-49f5-9da6-f5a3bdd04dc2 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1554 microversion: 2.1 time: 0.153310 Aug 18 12:25:33.305237 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 301/613] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:33 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:33.977252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b4b37a6b-f07d-4191-bd47-4ae5a5255cf5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:33.977823 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b4b37a6b-f07d-4191-bd47-4ae5a5255cf5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:33.984507 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4b37a6b-f07d-4191-bd47-4ae5a5255cf5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:33.985250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4b37a6b-f07d-4191-bd47-4ae5a5255cf5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:33.985683 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4b37a6b-f07d-4191-bd47-4ae5a5255cf5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:33.986374 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4b37a6b-f07d-4191-bd47-4ae5a5255cf5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:33.986823 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4b37a6b-f07d-4191-bd47-4ae5a5255cf5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:33.987245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4b37a6b-f07d-4191-bd47-4ae5a5255cf5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:34.117456 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b4b37a6b-f07d-4191-bd47-4ae5a5255cf5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:34.125577 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b4b37a6b-f07d-4191-bd47-4ae5a5255cf5 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1689 microversion: 2.1 time: 0.152167 Aug 18 12:25:34.126210 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 313/614] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:33 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:34.325489 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4df48544-06c9-4f8e-85f5-78c83d28c30d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:34.326056 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4df48544-06c9-4f8e-85f5-78c83d28c30d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:34.332732 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4df48544-06c9-4f8e-85f5-78c83d28c30d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:34.333248 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4df48544-06c9-4f8e-85f5-78c83d28c30d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:34.333684 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4df48544-06c9-4f8e-85f5-78c83d28c30d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:34.334639 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4df48544-06c9-4f8e-85f5-78c83d28c30d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:34.335125 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4df48544-06c9-4f8e-85f5-78c83d28c30d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:34.335592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4df48544-06c9-4f8e-85f5-78c83d28c30d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:34.464106 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4df48544-06c9-4f8e-85f5-78c83d28c30d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:34.471638 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4df48544-06c9-4f8e-85f5-78c83d28c30d tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1554 microversion: 2.1 time: 0.150072 Aug 18 12:25:34.472201 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 302/615] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:34 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:35.147752 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2edb2bb7-0036-44f4-978d-268e0727242c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:35.148333 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-2edb2bb7-0036-44f4-978d-268e0727242c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:35.154645 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2edb2bb7-0036-44f4-978d-268e0727242c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:35.155112 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2edb2bb7-0036-44f4-978d-268e0727242c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:35.155831 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2edb2bb7-0036-44f4-978d-268e0727242c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:35.156508 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2edb2bb7-0036-44f4-978d-268e0727242c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:35.156948 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2edb2bb7-0036-44f4-978d-268e0727242c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:35.157504 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2edb2bb7-0036-44f4-978d-268e0727242c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:35.293786 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2edb2bb7-0036-44f4-978d-268e0727242c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:35.301765 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2edb2bb7-0036-44f4-978d-268e0727242c tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1689 microversion: 2.1 time: 0.158207 Aug 18 12:25:35.302324 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 314/616] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:35 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:35.494172 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-70f8d726-bc50-4bd2-8bf8-64bf851fcac3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:35.494787 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-70f8d726-bc50-4bd2-8bf8-64bf851fcac3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:35.501432 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70f8d726-bc50-4bd2-8bf8-64bf851fcac3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:35.501916 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70f8d726-bc50-4bd2-8bf8-64bf851fcac3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:35.502355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70f8d726-bc50-4bd2-8bf8-64bf851fcac3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:35.503063 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70f8d726-bc50-4bd2-8bf8-64bf851fcac3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:35.503548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70f8d726-bc50-4bd2-8bf8-64bf851fcac3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:35.503977 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70f8d726-bc50-4bd2-8bf8-64bf851fcac3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:35.632020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-70f8d726-bc50-4bd2-8bf8-64bf851fcac3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:35.639642 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-70f8d726-bc50-4bd2-8bf8-64bf851fcac3 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1554 microversion: 2.1 time: 0.149991 Aug 18 12:25:35.640716 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 303/617] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:35 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:36.324421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-30303281-d45e-4bf8-bbce-5784ca6e93a3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:36.325208 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-30303281-d45e-4bf8-bbce-5784ca6e93a3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:36.335505 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30303281-d45e-4bf8-bbce-5784ca6e93a3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:36.336285 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30303281-d45e-4bf8-bbce-5784ca6e93a3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:36.336936 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30303281-d45e-4bf8-bbce-5784ca6e93a3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:36.337646 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30303281-d45e-4bf8-bbce-5784ca6e93a3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:36.338100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30303281-d45e-4bf8-bbce-5784ca6e93a3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:36.338534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30303281-d45e-4bf8-bbce-5784ca6e93a3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:36.661555 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8045269b-75a2-49cf-b4ef-1e3ebb6430a9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:36.662445 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8045269b-75a2-49cf-b4ef-1e3ebb6430a9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:36.670278 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8045269b-75a2-49cf-b4ef-1e3ebb6430a9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:36.671726 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8045269b-75a2-49cf-b4ef-1e3ebb6430a9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:36.672443 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8045269b-75a2-49cf-b4ef-1e3ebb6430a9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:36.673486 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8045269b-75a2-49cf-b4ef-1e3ebb6430a9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:36.674168 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8045269b-75a2-49cf-b4ef-1e3ebb6430a9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:36.674839 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8045269b-75a2-49cf-b4ef-1e3ebb6430a9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:36.700688 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:25:36.700867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Thu Aug 18 12:25:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e (ip 10.222.0.98) !!! Aug 18 12:25:36.888682 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-30303281-d45e-4bf8-bbce-5784ca6e93a3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:36.899141 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-30303281-d45e-4bf8-bbce-5784ca6e93a3 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1689 microversion: 2.1 time: 0.580788 Aug 18 12:25:36.954314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 315/618] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:36 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1689 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:36.954731 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8045269b-75a2-49cf-b4ef-1e3ebb6430a9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc7f1b599034654a3ed64dde2145bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944cd11144ca4cbf86962a3c9494ecbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:36.954731 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8045269b-75a2-49cf-b4ef-1e3ebb6430a9 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 200 len: 1554 microversion: 2.1 time: 0.274295 Aug 18 12:25:36.954731 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 304/619] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:36 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 1554 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:36.963195 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-984c7a6d-176a-4a63-a2ee-483ecf0199ab req-b87224e6-6af3-4d3d-a92a-66f1f0871d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327172e2-b2a2-479d-89f8-1810071e75ab", "name": "network-vif-deleted", "tag": "1056879d-4dc9-4cb8-a5a7-372ccbc78813"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:36.972628 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-984c7a6d-176a-4a63-a2ee-483ecf0199ab req-b87224e6-6af3-4d3d-a92a-66f1f0871d4a service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:36.973672 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-984c7a6d-176a-4a63-a2ee-483ecf0199ab req-b87224e6-6af3-4d3d-a92a-66f1f0871d4a service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:36.974127 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-984c7a6d-176a-4a63-a2ee-483ecf0199ab req-b87224e6-6af3-4d3d-a92a-66f1f0871d4a service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:36.985669 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-984c7a6d-176a-4a63-a2ee-483ecf0199ab req-b87224e6-6af3-4d3d-a92a-66f1f0871d4a service nova] Creating event network-vif-deleted:1056879d-4dc9-4cb8-a5a7-372ccbc78813 for instance 327172e2-b2a2-479d-89f8-1810071e75ab on hv-cinder-83602 Aug 18 12:25:36.990496 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-984c7a6d-176a-4a63-a2ee-483ecf0199ab req-b87224e6-6af3-4d3d-a92a-66f1f0871d4a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031117 Aug 18 12:25:36.991401 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 316/620] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:37.493716 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-ca40bd9a-5e67-4ff9-a63f-5cbf06a62810 req-51d483ec-c3fe-4d24-84f4-987fc69260a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e", "name": "network-vif-deleted", "tag": "5d0b49eb-e985-4312-8c18-82dd61f5b4ea"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:37.506585 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-ca40bd9a-5e67-4ff9-a63f-5cbf06a62810 req-51d483ec-c3fe-4d24-84f4-987fc69260a9 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:37.507376 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-ca40bd9a-5e67-4ff9-a63f-5cbf06a62810 req-51d483ec-c3fe-4d24-84f4-987fc69260a9 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:37.508151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-ca40bd9a-5e67-4ff9-a63f-5cbf06a62810 req-51d483ec-c3fe-4d24-84f4-987fc69260a9 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:37.528027 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-ca40bd9a-5e67-4ff9-a63f-5cbf06a62810 req-51d483ec-c3fe-4d24-84f4-987fc69260a9 service nova] Creating event network-vif-deleted:5d0b49eb-e985-4312-8c18-82dd61f5b4ea for instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e on hv-cinder-83602 Aug 18 12:25:37.533956 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-ca40bd9a-5e67-4ff9-a63f-5cbf06a62810 req-51d483ec-c3fe-4d24-84f4-987fc69260a9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043879 Aug 18 12:25:37.534816 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 305/621] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:37.922366 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:37.923065 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:37.929317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:37.929847 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:37.930281 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:37.930972 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:37.931435 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:37.931909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:37.955828 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:37.956552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] [instance: 327172e2-b2a2-479d-89f8-1810071e75ab] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:37.963334 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:37.963999 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:37.964453 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:37.965161 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:37.965628 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:37.966042 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:37.979582 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:37.980575 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:37.981061 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:37.982036 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lazy-loading 'fault' on Instance uuid e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:25:37.990706 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] HTTP exception thrown: Instance 327172e2-b2a2-479d-89f8-1810071e75ab could not be found. Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Request method failure captured: Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab HTTP/1.1 Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i8Qx3OR8pg_dvzKkTY7YtpF7s4OhXyRmof6F3Tek06Rt5-bLssFLhgjin44YPvvsb97kVg0ZdoIFu8rLMyWYSIuNLvxpz0_Z7Di-Llgxsh5kTAZcboZPhHGzSGO1R3Ue8wHU6Fdl7JllfgPaHM68PjuNzs5OpBOgrHIg-wZdb-AqPE Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 944cd11144ca4cbf86962a3c9494ecbd Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-TestMinimumBasicScenario-1027604797 Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:25:37.992472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/944cd11144ca4cbf86962a3c9494ecbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/944cd11144ca4cbf86962a3c9494ecbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/944cd11144ca4cbf86962a3c9494ecbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_944cd11144ca4cbf86962a3c9494ecbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-TestMinimumBasicScenario-1027604797 Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 944cd11144ca4cbf86962a3c9494ecbd Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1027604797 Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-TestMinimumBasicScenario-1027604797-project Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: fcc7f1b599034654a3ed64dde2145bf8 Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-TestMinimumBasicScenario-1027604797-project Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 327172e2-b2a2-479d-89f8-1810071e75ab could not be found. Aug 18 12:25:37.993885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '327172e2-b2a2-479d-89f8-1810071e75ab'} Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 327172e2-b2a2-479d-89f8-1810071e75ab could not be found. Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:25:37.994656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 327172e2-b2a2-479d-89f8-1810071e75ab could not be found. Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 327172e2-b2a2-479d-89f8-1810071e75ab could not be found. Aug 18 12:25:37.996634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:37.999224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Returning 404 to user: Instance 327172e2-b2a2-479d-89f8-1810071e75ab could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:25:37.999224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-66096b6a-3f0b-4aa8-aa6d-3afeafe3de23 tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab" status: 404 len: 111 microversion: 2.1 time: 0.043161 Aug 18 12:25:37.999224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 306/622] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:37 2022] GET /compute/v2.1/servers/327172e2-b2a2-479d-89f8-1810071e75ab => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:25:38.004021 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2f3d8e3b-80ab-4809-a019-83a62eb726ad tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] Calling method '.version_select at 0x7f3787ed5700>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:38.025790 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:38.033305 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-46739b85-b702-427b-a239-98ce0e959e7a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 200 len: 1334 microversion: 2.1 time: 0.116242 Aug 18 12:25:38.033873 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 317/623] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:37 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 1334 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:38.105751 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2f3d8e3b-80ab-4809-a019-83a62eb726ad tempest-TestMinimumBasicScenario-1027604797 tempest-TestMinimumBasicScenario-1027604797-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-568288691" status: 202 len: 0 microversion: 2.1 time: 0.106111 Aug 18 12:25:38.106331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 307/624] 10.222.0.98 () {58 vars in 1269 bytes} [Thu Aug 18 12:25:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-568288691 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:25:39.060383 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:39.061020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:39.068242 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:39.068726 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:39.069161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:39.069861 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:39.070313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:39.070808 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:39.085079 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] HTTP exception thrown: Instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e could not be found. Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Request method failure captured: Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e HTTP/1.1 Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i6Pc1iShlC4ACTcOWwbv896mVUJ_VCuPhjuPkGFza81A1LvrVOukwsF5_eB3xdrTQK1i8i79gID74Vli7zDHlRdCqloU9q3_SZ2580Is2rSbBhnRdmwSF3kQoOWg2EYGof8CdvJE5X_A8zanheUiphbBAGE7-CpkQl3RNeVfWW7cqs Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 965cf5f488364e0ea8b52cdc78de2641 Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:25:39.086770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 965cf5f488364e0ea8b52cdc78de2641 Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-ServerRescueNegativeTestJSON-934320463-project Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 2e8380a466484c83bca842518d171048 Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-ServerRescueNegativeTestJSON-934320463-project Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e could not be found. Aug 18 12:25:39.088334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': 'e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e'} Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e could not be found. Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:25:39.093407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e could not be found. Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e could not be found. Aug 18 12:25:39.094841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:39.096198 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Returning 404 to user: Instance e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:25:39.096198 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ce544eb1-cba5-4477-9485-b44a7f697f6a tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e" status: 404 len: 111 microversion: 2.1 time: 0.031699 Aug 18 12:25:39.096198 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 318/625] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:39 2022] GET /compute/v2.1/servers/e9ae2a0c-7b7b-4b83-8880-c0fd4daee57e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:25:39.097066 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f370715f-da1e-4317-9501-b0e17d891f2d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '.version_select at 0x7f3787ea31f0>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:39.178947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f370715f-da1e-4317-9501-b0e17d891f2d tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-413295309" status: 202 len: 0 microversion: 2.1 time: 0.085753 Aug 18 12:25:39.179547 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 308/626] 10.222.0.98 () {58 vars in 1218 bytes} [Thu Aug 18 12:25:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-413295309 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:25:42.781221 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fb22cf33-84cc-4f30-8f34-98fbfbc568e9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:42.782356 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fb22cf33-84cc-4f30-8f34-98fbfbc568e9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:42.789132 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb22cf33-84cc-4f30-8f34-98fbfbc568e9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:42.790166 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb22cf33-84cc-4f30-8f34-98fbfbc568e9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:42.791364 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb22cf33-84cc-4f30-8f34-98fbfbc568e9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:42.792360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb22cf33-84cc-4f30-8f34-98fbfbc568e9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:42.793221 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb22cf33-84cc-4f30-8f34-98fbfbc568e9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:42.793852 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb22cf33-84cc-4f30-8f34-98fbfbc568e9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:42.821213 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fb22cf33-84cc-4f30-8f34-98fbfbc568e9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:25:42.840764 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:43.156030 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fb22cf33-84cc-4f30-8f34-98fbfbc568e9 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 204 len: 0 microversion: 2.1 time: 0.378021 Aug 18 12:25:43.160367 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 319/627] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:25:42 2022] DELETE /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:25:43.167070 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-cc398444-ecfa-4f56-838b-06b2463cac00 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:43.168006 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-cc398444-ecfa-4f56-838b-06b2463cac00 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:43.176010 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc398444-ecfa-4f56-838b-06b2463cac00 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:43.176791 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc398444-ecfa-4f56-838b-06b2463cac00 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:43.177294 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc398444-ecfa-4f56-838b-06b2463cac00 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:43.178087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc398444-ecfa-4f56-838b-06b2463cac00 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:43.178613 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc398444-ecfa-4f56-838b-06b2463cac00 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:43.179116 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc398444-ecfa-4f56-838b-06b2463cac00 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:43.420243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-cc398444-ecfa-4f56-838b-06b2463cac00 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:43.428722 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-cc398444-ecfa-4f56-838b-06b2463cac00 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1509 microversion: 2.1 time: 0.266000 Aug 18 12:25:43.429308 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 309/628] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:43 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:44.452574 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3130f450-ad9c-4bc4-afe3-6a15fcc64b4b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:44.454628 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3130f450-ad9c-4bc4-afe3-6a15fcc64b4b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:44.463673 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3130f450-ad9c-4bc4-afe3-6a15fcc64b4b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:44.463673 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3130f450-ad9c-4bc4-afe3-6a15fcc64b4b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:44.463673 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3130f450-ad9c-4bc4-afe3-6a15fcc64b4b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:44.463673 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3130f450-ad9c-4bc4-afe3-6a15fcc64b4b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:44.464470 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3130f450-ad9c-4bc4-afe3-6a15fcc64b4b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:44.464470 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3130f450-ad9c-4bc4-afe3-6a15fcc64b4b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:44.703521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3130f450-ad9c-4bc4-afe3-6a15fcc64b4b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:44.708213 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3130f450-ad9c-4bc4-afe3-6a15fcc64b4b tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1509 microversion: 2.1 time: 0.260619 Aug 18 12:25:44.708797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 320/629] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:44 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1509 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:45.729641 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-574e31b7-4fe9-447f-8666-db03ccdbcda7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:45.730515 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-574e31b7-4fe9-447f-8666-db03ccdbcda7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:45.737752 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-574e31b7-4fe9-447f-8666-db03ccdbcda7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:45.738581 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-574e31b7-4fe9-447f-8666-db03ccdbcda7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:45.742911 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-574e31b7-4fe9-447f-8666-db03ccdbcda7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:45.742911 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-574e31b7-4fe9-447f-8666-db03ccdbcda7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:45.742911 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-574e31b7-4fe9-447f-8666-db03ccdbcda7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:45.742911 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-574e31b7-4fe9-447f-8666-db03ccdbcda7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:45.745218 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:45.993109 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-574e31b7-4fe9-447f-8666-db03ccdbcda7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:46.001867 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-574e31b7-4fe9-447f-8666-db03ccdbcda7 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1509 microversion: 2.1 time: 0.276150 Aug 18 12:25:46.002446 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 310/630] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:45 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:46.093128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-f1eb3b6b-9327-4ff3-9b40-be92f1e0d4c7 req-51cbf77b-6648-4276-bdc3-0122586d9892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d584dbe7-cf44-4182-8ee3-3a240b0a8f37", "name": "network-vif-deleted", "tag": "d8111269-50cb-47be-baad-3ecc1d3bf9f9"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:46.105005 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f1eb3b6b-9327-4ff3-9b40-be92f1e0d4c7 req-51cbf77b-6648-4276-bdc3-0122586d9892 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:46.105480 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f1eb3b6b-9327-4ff3-9b40-be92f1e0d4c7 req-51cbf77b-6648-4276-bdc3-0122586d9892 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:46.105910 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f1eb3b6b-9327-4ff3-9b40-be92f1e0d4c7 req-51cbf77b-6648-4276-bdc3-0122586d9892 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:46.118956 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-f1eb3b6b-9327-4ff3-9b40-be92f1e0d4c7 req-51cbf77b-6648-4276-bdc3-0122586d9892 service nova] Creating event network-vif-deleted:d8111269-50cb-47be-baad-3ecc1d3bf9f9 for instance d584dbe7-cf44-4182-8ee3-3a240b0a8f37 on hv-cinder-83602 Aug 18 12:25:46.123921 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-f1eb3b6b-9327-4ff3-9b40-be92f1e0d4c7 req-51cbf77b-6648-4276-bdc3-0122586d9892 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034914 Aug 18 12:25:46.125729 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 321/631] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:47.023632 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:47.024221 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:47.034616 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:47.035113 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:47.035589 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:47.036310 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:47.036769 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:47.037244 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:47.071217 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:47.071778 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:47.072225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:47.072682 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lazy-loading 'fault' on Instance uuid d584dbe7-cf44-4182-8ee3-3a240b0a8f37 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:25:47.117934 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:47.125996 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-47febc3d-38a7-40d1-afad-67f66c775d76 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 200 len: 1312 microversion: 2.1 time: 0.105706 Aug 18 12:25:47.126565 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 311/632] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:47 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:48.147733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:48.148418 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: d584dbe7-cf44-4182-8ee3-3a240b0a8f37] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:48.154555 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:48.155038 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:48.157225 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:48.157225 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:48.157225 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:48.157582 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:48.170920 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] HTTP exception thrown: Instance d584dbe7-cf44-4182-8ee3-3a240b0a8f37 could not be found. Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Request method failure captured: Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 HTTP/1.1 Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i6Pc1iShlC4ACTcOWwbv896mVUJ_VCuPhjuPkGFza81A1LvrVOukwsF5_eB3xdrTQK1i8i79gID74Vli7zDHlRdCqloU9q3_SZ2580Is2rSbBhnRdmwSF3kQoOWg2EYGof8CdvJE5X_A8zanheUiphbBAGE7-CpkQl3RNeVfWW7cqs Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 965cf5f488364e0ea8b52cdc78de2641 Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:25:48.173219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 965cf5f488364e0ea8b52cdc78de2641 Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-ServerRescueNegativeTestJSON-934320463-project Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 2e8380a466484c83bca842518d171048 Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-ServerRescueNegativeTestJSON-934320463-project Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance d584dbe7-cf44-4182-8ee3-3a240b0a8f37 could not be found. Aug 18 12:25:48.174738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': 'd584dbe7-cf44-4182-8ee3-3a240b0a8f37'} Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d584dbe7-cf44-4182-8ee3-3a240b0a8f37 could not be found. Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:25:48.179676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d584dbe7-cf44-4182-8ee3-3a240b0a8f37 could not be found. Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d584dbe7-cf44-4182-8ee3-3a240b0a8f37 could not be found. Aug 18 12:25:48.181705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:25:48.182987 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Returning 404 to user: Instance d584dbe7-cf44-4182-8ee3-3a240b0a8f37 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:25:48.182987 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-bff04cc8-0f0a-4517-aff5-2894182a6e50 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37" status: 404 len: 111 microversion: 2.1 time: 0.031734 Aug 18 12:25:48.182987 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 322/633] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:48 2022] GET /compute/v2.1/servers/d584dbe7-cf44-4182-8ee3-3a240b0a8f37 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:25:48.185883 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-9c1a959e-728d-497e-bee5-a3f0a65d1f29 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:48.186633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-9c1a959e-728d-497e-bee5-a3f0a65d1f29 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:48.193413 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9c1a959e-728d-497e-bee5-a3f0a65d1f29 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:48.197549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9c1a959e-728d-497e-bee5-a3f0a65d1f29 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:48.197549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9c1a959e-728d-497e-bee5-a3f0a65d1f29 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:48.197549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9c1a959e-728d-497e-bee5-a3f0a65d1f29 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:48.197549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9c1a959e-728d-497e-bee5-a3f0a65d1f29 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:48.197967 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9c1a959e-728d-497e-bee5-a3f0a65d1f29 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:48.223178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-9c1a959e-728d-497e-bee5-a3f0a65d1f29 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Going to try to terminate instance {{(pid=121244) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:25:48.601363 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-9c1a959e-728d-497e-bee5-a3f0a65d1f29 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 204 len: 0 microversion: 2.1 time: 0.421204 Aug 18 12:25:48.601956 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 312/634] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:25:48 2022] DELETE /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:25:48.610094 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-93bc1185-9e03-44f7-8a95-41a637226287 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:48.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-93bc1185-9e03-44f7-8a95-41a637226287 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:48.619028 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93bc1185-9e03-44f7-8a95-41a637226287 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:48.619757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93bc1185-9e03-44f7-8a95-41a637226287 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:48.620197 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93bc1185-9e03-44f7-8a95-41a637226287 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:48.620918 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93bc1185-9e03-44f7-8a95-41a637226287 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:48.621376 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93bc1185-9e03-44f7-8a95-41a637226287 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:48.621867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-93bc1185-9e03-44f7-8a95-41a637226287 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:48.754233 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-93bc1185-9e03-44f7-8a95-41a637226287 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:48.763185 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-93bc1185-9e03-44f7-8a95-41a637226287 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.157018 Aug 18 12:25:48.763811 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 323/635] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:48 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:49.787071 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0708464f-9bac-4fbe-89e2-0a59f380c4ee tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:49.787787 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0708464f-9bac-4fbe-89e2-0a59f380c4ee tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:49.794429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0708464f-9bac-4fbe-89e2-0a59f380c4ee tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:49.794913 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0708464f-9bac-4fbe-89e2-0a59f380c4ee tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:49.795348 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0708464f-9bac-4fbe-89e2-0a59f380c4ee tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:49.796069 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0708464f-9bac-4fbe-89e2-0a59f380c4ee tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:49.796529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0708464f-9bac-4fbe-89e2-0a59f380c4ee tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:49.796955 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0708464f-9bac-4fbe-89e2-0a59f380c4ee tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:49.931983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0708464f-9bac-4fbe-89e2-0a59f380c4ee tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:49.940024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0708464f-9bac-4fbe-89e2-0a59f380c4ee tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.157244 Aug 18 12:25:49.940584 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 313/636] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:49 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:50.960292 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a78d48cc-ea92-4d7a-aa75-694f627bf094 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:50.960901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a78d48cc-ea92-4d7a-aa75-694f627bf094 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:50.967335 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a78d48cc-ea92-4d7a-aa75-694f627bf094 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:50.967852 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a78d48cc-ea92-4d7a-aa75-694f627bf094 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:50.968289 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a78d48cc-ea92-4d7a-aa75-694f627bf094 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:50.969564 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a78d48cc-ea92-4d7a-aa75-694f627bf094 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:50.970015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a78d48cc-ea92-4d7a-aa75-694f627bf094 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:50.970443 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a78d48cc-ea92-4d7a-aa75-694f627bf094 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:51.096492 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a78d48cc-ea92-4d7a-aa75-694f627bf094 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:51.103995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a78d48cc-ea92-4d7a-aa75-694f627bf094 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.147536 Aug 18 12:25:51.104561 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 324/637] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:50 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:52.125861 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c43fae22-025e-490c-a36b-c004121a5870 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:52.126415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c43fae22-025e-490c-a36b-c004121a5870 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:52.133179 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c43fae22-025e-490c-a36b-c004121a5870 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:52.133669 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c43fae22-025e-490c-a36b-c004121a5870 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:52.134118 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c43fae22-025e-490c-a36b-c004121a5870 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:52.134817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c43fae22-025e-490c-a36b-c004121a5870 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:52.135265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c43fae22-025e-490c-a36b-c004121a5870 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:52.135732 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c43fae22-025e-490c-a36b-c004121a5870 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:52.274743 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c43fae22-025e-490c-a36b-c004121a5870 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8380a466484c83bca842518d171048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965cf5f488364e0ea8b52cdc78de2641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:52.282961 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c43fae22-025e-490c-a36b-c004121a5870 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 200 len: 1523 microversion: 2.1 time: 0.161654 Aug 18 12:25:52.295965 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 314/638] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:52 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:52.324594 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-54946cce-51ea-4c7b-829f-de8d3b9fb58a req-0a7ca730-efb0-40f6-a6be-6f779c616266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4aedfb-2e3b-400c-9c97-9a0939976eb2", "name": "network-vif-deleted", "tag": "cd3bd10f-38d4-4066-b60f-99ec50c216c4"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:52.334235 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-54946cce-51ea-4c7b-829f-de8d3b9fb58a req-0a7ca730-efb0-40f6-a6be-6f779c616266 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:52.334806 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-54946cce-51ea-4c7b-829f-de8d3b9fb58a req-0a7ca730-efb0-40f6-a6be-6f779c616266 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:52.335239 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-54946cce-51ea-4c7b-829f-de8d3b9fb58a req-0a7ca730-efb0-40f6-a6be-6f779c616266 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:52.346053 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-54946cce-51ea-4c7b-829f-de8d3b9fb58a req-0a7ca730-efb0-40f6-a6be-6f779c616266 service nova] Creating event network-vif-deleted:cd3bd10f-38d4-4066-b60f-99ec50c216c4 for instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 on hv-cinder-83602 Aug 18 12:25:52.350915 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-54946cce-51ea-4c7b-829f-de8d3b9fb58a req-0a7ca730-efb0-40f6-a6be-6f779c616266 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029913 Aug 18 12:25:52.351582 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 325/639] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:53.305273 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:53.305971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] [instance: 8e4aedfb-2e3b-400c-9c97-9a0939976eb2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:53.312330 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:53.313318 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:53.313754 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:53.314453 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:53.314903 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:53.315326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:53.329216 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] HTTP exception thrown: Instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 could not be found. Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Request method failure captured: Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 HTTP/1.1 Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i6Pc1iShlC4ACTcOWwbv896mVUJ_VCuPhjuPkGFza81A1LvrVOukwsF5_eB3xdrTQK1i8i79gID74Vli7zDHlRdCqloU9q3_SZ2580Is2rSbBhnRdmwSF3kQoOWg2EYGof8CdvJE5X_A8zanheUiphbBAGE7-CpkQl3RNeVfWW7cqs Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 965cf5f488364e0ea8b52cdc78de2641 Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:25:53.333790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_965cf5f488364e0ea8b52cdc78de2641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 965cf5f488364e0ea8b52cdc78de2641 Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-934320463 Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-ServerRescueNegativeTestJSON-934320463-project Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 2e8380a466484c83bca842518d171048 Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-ServerRescueNegativeTestJSON-934320463-project Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 could not be found. Aug 18 12:25:53.335254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '8e4aedfb-2e3b-400c-9c97-9a0939976eb2'} Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 could not be found. Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:25:53.336049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 could not be found. Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 could not be found. Aug 18 12:25:53.337251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:25:53.338768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] Returning 404 to user: Instance 8e4aedfb-2e3b-400c-9c97-9a0939976eb2 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:25:53.338768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c67e4273-d533-4d96-8821-0b2bdb993914 tempest-ServerRescueNegativeTestJSON-934320463 tempest-ServerRescueNegativeTestJSON-934320463-project] 10.222.0.98 "GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2" status: 404 len: 111 microversion: 2.1 time: 0.030949 Aug 18 12:25:53.338768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 315/640] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:53 2022] GET /compute/v2.1/servers/8e4aedfb-2e3b-400c-9c97-9a0939976eb2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:25:55.230831 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5bdc25fa-78e6-4da2-8325-1768138212bb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:55.231686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5bdc25fa-78e6-4da2-8325-1768138212bb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:55.234755 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:55.242710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5bdc25fa-78e6-4da2-8325-1768138212bb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:55.243615 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5bdc25fa-78e6-4da2-8325-1768138212bb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:55.244048 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5bdc25fa-78e6-4da2-8325-1768138212bb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:55.244811 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5bdc25fa-78e6-4da2-8325-1768138212bb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:55.245326 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5bdc25fa-78e6-4da2-8325-1768138212bb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:55.245812 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5bdc25fa-78e6-4da2-8325-1768138212bb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:55.276931 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5bdc25fa-78e6-4da2-8325-1768138212bb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-volume_attachments/056a3015-2e66-4202-9f1c-bf9c6a9a193a" status: 200 len: 194 microversion: 2.20 time: 0.051283 Aug 18 12:25:55.282344 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 326/641] 10.222.0.98 () {60 vars in 1454 bytes} [Thu Aug 18 12:25:55 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-volume_attachments/056a3015-2e66-4202-9f1c-bf9c6a9a193a => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:25:55.352972 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b4fd8d2f-e717-497c-ba60-999956e2de25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:55.354044 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b4fd8d2f-e717-497c-ba60-999956e2de25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:55.360899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b4fd8d2f-e717-497c-ba60-999956e2de25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:55.361385 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b4fd8d2f-e717-497c-ba60-999956e2de25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:55.365921 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b4fd8d2f-e717-497c-ba60-999956e2de25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:55.365921 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b4fd8d2f-e717-497c-ba60-999956e2de25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:55.365921 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b4fd8d2f-e717-497c-ba60-999956e2de25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:55.365921 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b4fd8d2f-e717-497c-ba60-999956e2de25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:55.448044 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-b4fd8d2f-e717-497c-ba60-999956e2de25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lazy-loading 'services' on Instance uuid 9c4dfc92-fb5b-46f3-a14a-992de65d7adb {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:25:55.700907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b4fd8d2f-e717-497c-ba60-999956e2de25 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-volume_attachments/056a3015-2e66-4202-9f1c-bf9c6a9a193a" status: 202 len: 0 microversion: 2.20 time: 0.352023 Aug 18 12:25:55.701584 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 316/642] 10.222.0.98 () {60 vars in 1457 bytes} [Thu Aug 18 12:25:55 2022] DELETE /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-volume_attachments/056a3015-2e66-4202-9f1c-bf9c6a9a193a => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:25:55.710096 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0fad8f8b-619c-43c0-9f89-25a49200474b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:55.712329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0fad8f8b-619c-43c0-9f89-25a49200474b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:55.724215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0fad8f8b-619c-43c0-9f89-25a49200474b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:55.725553 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0fad8f8b-619c-43c0-9f89-25a49200474b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:55.726425 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0fad8f8b-619c-43c0-9f89-25a49200474b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:55.731525 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0fad8f8b-619c-43c0-9f89-25a49200474b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:55.732025 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0fad8f8b-619c-43c0-9f89-25a49200474b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:55.732471 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0fad8f8b-619c-43c0-9f89-25a49200474b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:55.772266 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0fad8f8b-619c-43c0-9f89-25a49200474b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065836 Aug 18 12:25:55.772828 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 327/643] 10.222.0.98 () {60 vars in 1343 bytes} [Thu Aug 18 12:25:55 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:25:56.786420 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-dab9b25b-008c-401b-aba8-77257bb0f85e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:56.789103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-dab9b25b-008c-401b-aba8-77257bb0f85e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:56.791119 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:56.796191 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dab9b25b-008c-401b-aba8-77257bb0f85e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:56.797235 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dab9b25b-008c-401b-aba8-77257bb0f85e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:56.797808 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dab9b25b-008c-401b-aba8-77257bb0f85e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:56.798517 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dab9b25b-008c-401b-aba8-77257bb0f85e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:56.798965 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dab9b25b-008c-401b-aba8-77257bb0f85e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:56.799429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dab9b25b-008c-401b-aba8-77257bb0f85e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:56.829426 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-dab9b25b-008c-401b-aba8-77257bb0f85e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048343 Aug 18 12:25:56.829903 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 317/644] 10.222.0.98 () {60 vars in 1343 bytes} [Thu Aug 18 12:25:56 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:56.912842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-24d36ca3-5cfb-4a5e-8161-f5228aee09ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:56.913404 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-24d36ca3-5cfb-4a5e-8161-f5228aee09ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:56.920434 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24d36ca3-5cfb-4a5e-8161-f5228aee09ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:56.920920 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24d36ca3-5cfb-4a5e-8161-f5228aee09ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:56.921355 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24d36ca3-5cfb-4a5e-8161-f5228aee09ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:56.922548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24d36ca3-5cfb-4a5e-8161-f5228aee09ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:56.923000 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24d36ca3-5cfb-4a5e-8161-f5228aee09ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:56.923513 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-24d36ca3-5cfb-4a5e-8161-f5228aee09ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:56.956008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-24d36ca3-5cfb-4a5e-8161-f5228aee09ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:25:57.303409 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-24d36ca3-5cfb-4a5e-8161-f5228aee09ac tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 204 len: 0 microversion: 2.20 time: 0.394519 Aug 18 12:25:57.304142 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 328/645] 10.222.0.98 () {60 vars in 1280 bytes} [Thu Aug 18 12:25:56 2022] DELETE /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 12:25:57.312177 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:57.312791 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:57.319243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:57.319757 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:57.320190 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:57.320869 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:57.321312 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:57.321726 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:57.454229 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:57.462272 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:57.463823 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:57.464989 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-dd0a6840-8855-4217-bf5c-d414076810d9 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.156634 Aug 18 12:25:57.465545 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 318/646] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:57 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:58.489857 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:58.490565 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:58.497913 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:58.498808 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:58.499712 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:58.500737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:58.501317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:58.501972 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:58.661290 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:58.681774 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:58.681774 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:58.681774 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-abd4e1de-079c-49f2-9b50-5641db02b6b5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1722 microversion: 2.20 time: 0.194542 Aug 18 12:25:58.682243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 329/647] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:58 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:25:59.718556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:59.719174 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:59.728962 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:59.728962 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:59.728962 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:59.731539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:59.732047 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:59.732484 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:59.808229 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:59.818420 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:59.820359 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:59.821584 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-46797512-93c9-487f-b8ae-382fc8322fd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1655 microversion: 2.20 time: 0.108118 Aug 18 12:25:59.822300 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 319/648] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:25:59 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:00.143871 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-fe0570ce-a9e7-455b-b8fc-823884c5e3b6 req-b2accf4a-bd00-4ad2-b343-e653be5e3c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4dfc92-fb5b-46f3-a14a-992de65d7adb", "name": "network-vif-deleted", "tag": "45eda560-60cf-411c-954a-1838984f4e8f"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:00.153784 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-fe0570ce-a9e7-455b-b8fc-823884c5e3b6 req-b2accf4a-bd00-4ad2-b343-e653be5e3c27 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:00.154368 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-fe0570ce-a9e7-455b-b8fc-823884c5e3b6 req-b2accf4a-bd00-4ad2-b343-e653be5e3c27 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:00.154871 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-fe0570ce-a9e7-455b-b8fc-823884c5e3b6 req-b2accf4a-bd00-4ad2-b343-e653be5e3c27 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:00.167320 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-fe0570ce-a9e7-455b-b8fc-823884c5e3b6 req-b2accf4a-bd00-4ad2-b343-e653be5e3c27 service nova] Creating event network-vif-deleted:45eda560-60cf-411c-954a-1838984f4e8f for instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb on hv-cinder-83602 Aug 18 12:26:00.172891 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-fe0570ce-a9e7-455b-b8fc-823884c5e3b6 req-b2accf4a-bd00-4ad2-b343-e653be5e3c27 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175918 Aug 18 12:26:00.173852 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 330/649] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:00.845624 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:00.846262 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:00.853371 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:00.853885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:00.854315 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:00.855053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:00.855574 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:00.855994 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:00.892421 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:00.892905 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:00.893336 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:00.893961 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lazy-loading 'fault' on Instance uuid 9c4dfc92-fb5b-46f3-a14a-992de65d7adb {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:26:00.949682 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:00.962759 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:00.970776 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:00.970776 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6914a626-af6f-4b7f-8724-8888f17b5123 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 200 len: 1370 microversion: 2.20 time: 0.125543 Aug 18 12:26:00.970776 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 320/650] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:00 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 1370 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:01.993243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:01.993997 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:02.000380 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:02.000859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:02.001357 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:02.001966 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:02.002411 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:02.002824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:02.017014 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] HTTP exception thrown: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Request method failure captured: Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb HTTP/1.1 Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i7zsB3dzbqxXgw1doijld1_rvMQqgqONX35Wg7g7dMwlFHPwbdR58-flVBXroxwq4z98q9Wju9Af7x0TlMzyG2wECkFX4lcHV6mToUl-4XbuVvgQfwenJvvZcufI-0X2Ky8X3wTi0BtcUEbiqxKvKB467K9Ztf_vixdSrFd9ZDmTwo Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:26:02.018647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: d98949bd624a4330a473ebe5de31586a Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:26:02.020360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '9c4dfc92-fb5b-46f3-a14a-992de65d7adb'} Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:02.022859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:26:02.024336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:02.025563 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Returning 404 to user: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:02.025563 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4eaafaa3-b1c2-40e6-817a-592d7e6afd93 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 404 len: 111 microversion: 2.20 time: 0.031795 Aug 18 12:26:02.025563 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 331/651] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:01 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 12:26:02.031370 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a6010c8d-fe6e-4101-ba04-066d87da4a04 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '.version_select at 0x7f3787ea3dc0>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:02.081844 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a6010c8d-fe6e-4101-ba04-066d87da4a04 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-747974205" status: 204 len: 0 microversion: 2.20 time: 0.054815 Aug 18 12:26:02.082490 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 321/652] 10.222.0.98 () {60 vars in 1259 bytes} [Thu Aug 18 12:26:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-747974205 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 12:26:02.920740 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e53b4748-bc69-4ea2-a58b-1703360680b6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Action: 'create', calling method: .version_select at 0x7f3787fd6280>, body: {"keypair": {"name": "tempest-keypair-2094065810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUmxsblbVCAdXs6eF5+uH/ebdBk9ITEalLyiAuouOYx3PqTvpjfFO0OY8lnkxpHMNg+S4CTONvXhDxgbron6YOHbJPC/wfQomHMg7WGBQh+tyiL+FPmj8sasyiHYY3jeA=="}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:02.937548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-e53b4748-bc69-4ea2-a58b-1703360680b6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Getting quotas for project 80ccf2ca9a634becb2eee93fddbd2258. Resources: {'key_pairs'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:26:02.941650 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-e53b4748-bc69-4ea2-a58b-1703360680b6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Getting quotas for user d98949bd624a4330a473ebe5de31586a and project 80ccf2ca9a634becb2eee93fddbd2258. Resources: {'key_pairs'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:26:03.030413 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e53b4748-bc69-4ea2-a58b-1703360680b6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.113526 Aug 18 12:26:03.032256 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 332/653] 10.222.0.98 () {62 vars in 1200 bytes} [Thu Aug 18 12:26:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 12:26:05.552011 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-366927454", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "538c1b4e-3178-42cd-9f3d-46d6a15a2ee9"}], "security_groups": [{"name": "tempest-securitygroup--408654768"}], "key_name": "tempest-keypair-2094065810", "user_data": "}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:05.657845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] validate_networks() for [('538c1b4e-3178-42cd-9f3d-46d6a15a2ee9', None, None, None, None, None)] {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:26:06.146880 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:26:06.147362 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:26:06.147873 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:26:06.148281 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:26:06.148695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:26:06.158944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:06.159475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:06.159918 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:06.160644 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:06.161094 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:06.161509 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:06.178839 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Getting quotas for project 80ccf2ca9a634becb2eee93fddbd2258. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:26:06.182831 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Getting quotas for user d98949bd624a4330a473ebe5de31586a and project 80ccf2ca9a634becb2eee93fddbd2258. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:26:06.194402 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:26:06.196686 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:26:06.351495 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-527206aa-4937-47c0-8c90-fcbc3771fcde tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.804234 Aug 18 12:26:06.352067 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 322/654] 10.222.0.98 () {62 vars in 1188 bytes} [Thu Aug 18 12:26:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 12:26:06.363499 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f560dbf6-bcde-46c4-9104-76be9e9cf14d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:06.364145 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f560dbf6-bcde-46c4-9104-76be9e9cf14d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:06.422131 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f560dbf6-bcde-46c4-9104-76be9e9cf14d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:06.429450 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f560dbf6-bcde-46c4-9104-76be9e9cf14d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:06.430971 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f560dbf6-bcde-46c4-9104-76be9e9cf14d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:06.432101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f560dbf6-bcde-46c4-9104-76be9e9cf14d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1281 microversion: 2.20 time: 0.072716 Aug 18 12:26:06.432658 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 333/655] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:06 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:07.454896 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:07.455576 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:07.462598 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:07.463161 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:07.463636 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:07.464262 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:07.464725 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:07.465175 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:07.535188 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:07.556211 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:07.560622 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:07.561771 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-70c1e10d-2638-4310-b41b-d361b9f4d09b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1285 microversion: 2.20 time: 0.111393 Aug 18 12:26:07.568049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 323/656] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:07 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:07.707683 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e29732e2-1fb7-4e1a-8781-527ecd6889aa tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:07.708633 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e29732e2-1fb7-4e1a-8781-527ecd6889aa tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:07.715967 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e29732e2-1fb7-4e1a-8781-527ecd6889aa tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:07.716542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e29732e2-1fb7-4e1a-8781-527ecd6889aa tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:07.716990 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e29732e2-1fb7-4e1a-8781-527ecd6889aa tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:07.717684 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e29732e2-1fb7-4e1a-8781-527ecd6889aa tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:07.718136 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e29732e2-1fb7-4e1a-8781-527ecd6889aa tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:07.718563 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e29732e2-1fb7-4e1a-8781-527ecd6889aa tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:07.745185 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e29732e2-1fb7-4e1a-8781-527ecd6889aa tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/ips" status: 200 len: 147 microversion: 2.1 time: 0.252521 Aug 18 12:26:07.745747 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 334/657] 10.222.0.98 () {58 vars in 1248 bytes} [Thu Aug 18 12:26:07 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/ips => generated 147 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:08.589804 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:08.590556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:08.598231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:08.598817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:08.599356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:08.600178 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:08.600710 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:08.601254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:08.667938 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:08.680741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:08.682275 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:08.683379 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a0881ffb-a117-4fcd-a029-9a887d1782ee tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1341 microversion: 2.20 time: 0.097569 Aug 18 12:26:08.685750 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 324/658] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:08 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:09.523908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fc238c7f-a3b3-4059-b82d-9a441825aaed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5df36712-a8dd-4d5f-99ec-6a6b2134bb75"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:09.527395 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fc238c7f-a3b3-4059-b82d-9a441825aaed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:09.534765 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc238c7f-a3b3-4059-b82d-9a441825aaed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:09.535245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc238c7f-a3b3-4059-b82d-9a441825aaed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:09.535710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc238c7f-a3b3-4059-b82d-9a441825aaed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:09.536532 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc238c7f-a3b3-4059-b82d-9a441825aaed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:09.537031 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc238c7f-a3b3-4059-b82d-9a441825aaed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:09.537453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc238c7f-a3b3-4059-b82d-9a441825aaed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:09.706595 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:09.711953 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:09.714119 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:09.714672 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:09.715191 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:09.715858 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:09.716375 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:09.716748 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:09.865909 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:09.880741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:09.882261 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:09.883662 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-76639023-65d9-461d-97cf-5b497c9aa427 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1406 microversion: 2.20 time: 0.181674 Aug 18 12:26:09.898662 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 325/659] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:09 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:10.250339 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fc238c7f-a3b3-4059-b82d-9a441825aaed tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "POST /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731368 Aug 18 12:26:10.251093 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 335/660] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:26:09 2022] POST /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:10.418970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-2ce9783d-3b34-451a-a0ad-ba65f0e9ef44 req-24add5f8-e118-4513-8568-8d73bdf30613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f0a98d-091a-4d0c-8e84-79fbb60d71a8", "tag": "5ed6bae6-8e44-4797-93ff-eaa620fb9744"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:10.429636 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-2ce9783d-3b34-451a-a0ad-ba65f0e9ef44 req-24add5f8-e118-4513-8568-8d73bdf30613 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:10.430352 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-2ce9783d-3b34-451a-a0ad-ba65f0e9ef44 req-24add5f8-e118-4513-8568-8d73bdf30613 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:10.430792 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-2ce9783d-3b34-451a-a0ad-ba65f0e9ef44 req-24add5f8-e118-4513-8568-8d73bdf30613 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:10.434981 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:10.443757 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-2ce9783d-3b34-451a-a0ad-ba65f0e9ef44 req-24add5f8-e118-4513-8568-8d73bdf30613 service nova] Creating event network-changed:5ed6bae6-8e44-4797-93ff-eaa620fb9744 for instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 on hv-cinder-83602 Aug 18 12:26:10.448707 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-2ce9783d-3b34-451a-a0ad-ba65f0e9ef44 req-24add5f8-e118-4513-8568-8d73bdf30613 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034221 Aug 18 12:26:10.449516 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 326/661] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:10.907567 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:10.908297 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:10.915131 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:10.915652 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:10.916099 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:10.916802 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:10.917291 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:10.917721 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:11.222729 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:11.230778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:11.232384 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:11.233923 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7a62ef6f-8fe8-49f2-95a5-88327cbec1af tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1406 microversion: 2.20 time: 0.331324 Aug 18 12:26:11.234487 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 336/662] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:10 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:12.256760 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:12.257558 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:12.264438 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:12.265029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:12.265501 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:12.266258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:12.266791 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:12.267279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:12.428424 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:12.436847 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:12.438383 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:12.439558 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-15409c22-ef9d-4264-846b-49c7b670f2d5 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1406 microversion: 2.20 time: 0.187526 Aug 18 12:26:12.440202 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 327/663] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:12 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:13.463134 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:13.463966 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:13.471042 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:13.471875 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:13.472309 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:13.473003 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:13.473497 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:13.473917 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:13.478181 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:13.619599 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:13.628375 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:13.629882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:13.631146 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-68a9eb94-56f7-4be4-b102-6b464da3103b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1406 microversion: 2.20 time: 0.171908 Aug 18 12:26:13.631860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 337/664] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:13 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:14.653805 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:14.654469 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:14.661169 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:14.661650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:14.662083 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:14.662757 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:14.663203 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:14.663648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:14.794756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:14.803451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:14.804984 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:14.806121 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5712bfd7-cdc0-45e0-a2eb-a3afa2362e70 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1406 microversion: 2.20 time: 0.156498 Aug 18 12:26:14.806675 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 328/665] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:14 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:15.597224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-52a89501-b5af-4159-9ada-81725411632e req-37bf6d1a-b6f5-4d63-99ec-00797c56cf3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f0a98d-091a-4d0c-8e84-79fbb60d71a8", "name": "network-vif-plugged", "status": "completed", "tag": "5ed6bae6-8e44-4797-93ff-eaa620fb9744"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:15.607090 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-52a89501-b5af-4159-9ada-81725411632e req-37bf6d1a-b6f5-4d63-99ec-00797c56cf3c service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:15.607966 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-52a89501-b5af-4159-9ada-81725411632e req-37bf6d1a-b6f5-4d63-99ec-00797c56cf3c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:15.608471 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-52a89501-b5af-4159-9ada-81725411632e req-37bf6d1a-b6f5-4d63-99ec-00797c56cf3c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:15.619572 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-52a89501-b5af-4159-9ada-81725411632e req-37bf6d1a-b6f5-4d63-99ec-00797c56cf3c service nova] Creating event network-vif-plugged:5ed6bae6-8e44-4797-93ff-eaa620fb9744 for instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 on hv-cinder-83602 Aug 18 12:26:15.624373 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-52a89501-b5af-4159-9ada-81725411632e req-37bf6d1a-b6f5-4d63-99ec-00797c56cf3c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152903 Aug 18 12:26:15.625065 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 338/666] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:15.829232 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:15.829845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:15.837549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:15.838387 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:15.838830 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:15.839564 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:15.840100 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:15.840711 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:15.978395 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:15.987262 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:15.988802 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:15.989910 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4d56b708-8c8f-49bd-9dc2-a610682f8dad tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1406 microversion: 2.20 time: 0.164680 Aug 18 12:26:15.990611 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 329/667] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:15 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:17.010668 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=6 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:17.015296 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:17.016017 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:17.022649 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:17.023120 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:17.023582 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:17.024265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:17.024709 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:17.025132 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:17.162196 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:17.171048 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:17.172618 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:17.173758 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c6cf16b5-b1f3-43fd-8d40-3c5c4221841c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1406 microversion: 2.20 time: 0.164110 Aug 18 12:26:17.174459 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 339/668] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:17 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:18.196063 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:18.196673 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:18.198600 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:18.199249 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=6 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:18.204424 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:18.204897 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:18.205324 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:18.206095 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:18.206453 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:18.206863 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:18.335920 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:18.344007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:18.345510 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:18.347435 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ed0f483d-fa0d-48d0-b2ea-6645b1836ab6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1598 microversion: 2.20 time: 0.155169 Aug 18 12:26:18.348053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 330/669] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:26:18 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:26:18.369192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ec6b0a94-d58b-42dc-a016-da43582a5d2a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:18.369683 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ec6b0a94-d58b-42dc-a016-da43582a5d2a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:18.376407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec6b0a94-d58b-42dc-a016-da43582a5d2a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:18.376888 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec6b0a94-d58b-42dc-a016-da43582a5d2a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:18.377324 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec6b0a94-d58b-42dc-a016-da43582a5d2a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:18.378015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec6b0a94-d58b-42dc-a016-da43582a5d2a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:18.378465 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec6b0a94-d58b-42dc-a016-da43582a5d2a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:18.378885 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec6b0a94-d58b-42dc-a016-da43582a5d2a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:18.453675 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ec6b0a94-d58b-42dc-a016-da43582a5d2a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088344 Aug 18 12:26:18.454269 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 340/670] 10.222.0.98 () {60 vars in 1316 bytes} [Thu Aug 18 12:26:18 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:26:19.484771 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-12ccb276-7883-4d79-8c42-50b64bd3b870 req-150682a0-ce77-44f8-a282-3a5b4feac8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f0a98d-091a-4d0c-8e84-79fbb60d71a8", "tag": "5ed6bae6-8e44-4797-93ff-eaa620fb9744"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:19.494609 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-12ccb276-7883-4d79-8c42-50b64bd3b870 req-150682a0-ce77-44f8-a282-3a5b4feac8b6 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:19.495084 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-12ccb276-7883-4d79-8c42-50b64bd3b870 req-150682a0-ce77-44f8-a282-3a5b4feac8b6 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:19.495534 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-12ccb276-7883-4d79-8c42-50b64bd3b870 req-150682a0-ce77-44f8-a282-3a5b4feac8b6 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:19.506855 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-12ccb276-7883-4d79-8c42-50b64bd3b870 req-150682a0-ce77-44f8-a282-3a5b4feac8b6 service nova] Creating event network-changed:5ed6bae6-8e44-4797-93ff-eaa620fb9744 for instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 on hv-cinder-83602 Aug 18 12:26:19.512020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-12ccb276-7883-4d79-8c42-50b64bd3b870 req-150682a0-ce77-44f8-a282-3a5b4feac8b6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090824 Aug 18 12:26:19.512610 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 331/671] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:20.961421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-dc5419d8-110a-474a-96ec-2328223d6feb tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:20.963587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-dc5419d8-110a-474a-96ec-2328223d6feb tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:20.969630 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc5419d8-110a-474a-96ec-2328223d6feb tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:20.970090 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc5419d8-110a-474a-96ec-2328223d6feb tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:20.970524 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc5419d8-110a-474a-96ec-2328223d6feb tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:20.971219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc5419d8-110a-474a-96ec-2328223d6feb tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:20.971693 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc5419d8-110a-474a-96ec-2328223d6feb tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:20.972117 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dc5419d8-110a-474a-96ec-2328223d6feb tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:21.000856 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-dc5419d8-110a-474a-96ec-2328223d6feb tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Aug 18 12:26:21.001405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 341/672] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:26:20 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:21.013538 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2afb0bb0-a562-4a4d-ae60-deb4036a61e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:21.014094 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2afb0bb0-a562-4a4d-ae60-deb4036a61e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:21.020916 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb0-a562-4a4d-ae60-deb4036a61e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:21.021418 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb0-a562-4a4d-ae60-deb4036a61e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:21.021851 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb0-a562-4a4d-ae60-deb4036a61e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:21.022528 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb0-a562-4a4d-ae60-deb4036a61e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:21.022978 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb0-a562-4a4d-ae60-deb4036a61e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:21.023396 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb0-a562-4a4d-ae60-deb4036a61e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:21.050540 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2afb0bb0-a562-4a4d-ae60-deb4036a61e9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments/5df36712-a8dd-4d5f-99ec-6a6b2134bb75" status: 200 len: 194 microversion: 2.1 time: 0.041746 Aug 18 12:26:21.051104 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 332/673] 10.222.0.98 () {58 vars in 1413 bytes} [Thu Aug 18 12:26:21 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments/5df36712-a8dd-4d5f-99ec-6a6b2134bb75 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:26:22.713926 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b4a0a90b-e830-41bc-9514-e458ef9e3eab tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a5dbf66-a87e-4ead-812a-de567ba4bd8f"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:22.718618 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b4a0a90b-e830-41bc-9514-e458ef9e3eab tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:22.725502 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4a0a90b-e830-41bc-9514-e458ef9e3eab tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:22.726089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4a0a90b-e830-41bc-9514-e458ef9e3eab tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:22.726567 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4a0a90b-e830-41bc-9514-e458ef9e3eab tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:22.727358 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4a0a90b-e830-41bc-9514-e458ef9e3eab tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:22.727843 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4a0a90b-e830-41bc-9514-e458ef9e3eab tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:22.728270 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b4a0a90b-e830-41bc-9514-e458ef9e3eab tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:23.472458 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b4a0a90b-e830-41bc-9514-e458ef9e3eab tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "POST /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.762216 Aug 18 12:26:23.473098 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 342/674] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:26:22 2022] POST /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments => generated 194 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:31.024276 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3031c587-43df-4e06-b7a2-a7474563f164 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:31.026452 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3031c587-43df-4e06-b7a2-a7474563f164 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:31.028762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:31.033397 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3031c587-43df-4e06-b7a2-a7474563f164 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:31.033879 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3031c587-43df-4e06-b7a2-a7474563f164 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:31.034317 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3031c587-43df-4e06-b7a2-a7474563f164 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:31.035004 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3031c587-43df-4e06-b7a2-a7474563f164 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:31.035475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3031c587-43df-4e06-b7a2-a7474563f164 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:31.035901 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3031c587-43df-4e06-b7a2-a7474563f164 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:31.067958 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3031c587-43df-4e06-b7a2-a7474563f164 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047554 Aug 18 12:26:31.068508 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 333/675] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:26:31 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:31.222501 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-9a46379f-cf79-46a7-9f74-b4ad2ec9e5ef tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:31.223106 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-9a46379f-cf79-46a7-9f74-b4ad2ec9e5ef tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:31.225059 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:31.229931 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9a46379f-cf79-46a7-9f74-b4ad2ec9e5ef tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:31.230404 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9a46379f-cf79-46a7-9f74-b4ad2ec9e5ef tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:31.230833 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9a46379f-cf79-46a7-9f74-b4ad2ec9e5ef tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:31.231563 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9a46379f-cf79-46a7-9f74-b4ad2ec9e5ef tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:31.232280 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9a46379f-cf79-46a7-9f74-b4ad2ec9e5ef tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:31.232733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9a46379f-cf79-46a7-9f74-b4ad2ec9e5ef tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:31.264667 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-9a46379f-cf79-46a7-9f74-b4ad2ec9e5ef tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments/5df36712-a8dd-4d5f-99ec-6a6b2134bb75" status: 200 len: 194 microversion: 2.1 time: 0.047067 Aug 18 12:26:31.265444 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 343/676] 10.222.0.98 () {58 vars in 1413 bytes} [Thu Aug 18 12:26:31 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments/5df36712-a8dd-4d5f-99ec-6a6b2134bb75 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:31.276037 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2da450b0-bee9-49cb-91f5-82729b0d4c8e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:31.276562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2da450b0-bee9-49cb-91f5-82729b0d4c8e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:31.283017 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2da450b0-bee9-49cb-91f5-82729b0d4c8e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:31.283529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2da450b0-bee9-49cb-91f5-82729b0d4c8e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:31.290703 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2da450b0-bee9-49cb-91f5-82729b0d4c8e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:31.290703 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2da450b0-bee9-49cb-91f5-82729b0d4c8e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:31.290703 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2da450b0-bee9-49cb-91f5-82729b0d4c8e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:31.290703 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2da450b0-bee9-49cb-91f5-82729b0d4c8e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:31.368335 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-2da450b0-bee9-49cb-91f5-82729b0d4c8e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lazy-loading 'services' on Instance uuid b330121b-dab2-4dbd-bf91-b0fd44ffcb84 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:26:31.570300 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2da450b0-bee9-49cb-91f5-82729b0d4c8e tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments/5df36712-a8dd-4d5f-99ec-6a6b2134bb75" status: 202 len: 0 microversion: 2.1 time: 0.298489 Aug 18 12:26:31.570916 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 334/677] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:26:31 2022] DELETE /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments/5df36712-a8dd-4d5f-99ec-6a6b2134bb75 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:26:33.757000 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-39bc1de6-3930-4f52-b34e-6171e32d44e0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:33.757584 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-39bc1de6-3930-4f52-b34e-6171e32d44e0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:33.764600 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39bc1de6-3930-4f52-b34e-6171e32d44e0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:33.765082 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39bc1de6-3930-4f52-b34e-6171e32d44e0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:33.765519 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39bc1de6-3930-4f52-b34e-6171e32d44e0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:33.766211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39bc1de6-3930-4f52-b34e-6171e32d44e0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:33.766660 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39bc1de6-3930-4f52-b34e-6171e32d44e0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:33.767076 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-39bc1de6-3930-4f52-b34e-6171e32d44e0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:33.801030 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-39bc1de6-3930-4f52-b34e-6171e32d44e0 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments/8a5dbf66-a87e-4ead-812a-de567ba4bd8f" status: 200 len: 194 microversion: 2.1 time: 0.048434 Aug 18 12:26:33.803349 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 344/678] 10.222.0.98 () {58 vars in 1413 bytes} [Thu Aug 18 12:26:33 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments/8a5dbf66-a87e-4ead-812a-de567ba4bd8f => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:33.813277 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-19e03bea-19fc-4db3-b12f-af525579ca21 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:33.813978 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-19e03bea-19fc-4db3-b12f-af525579ca21 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:33.822373 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-19e03bea-19fc-4db3-b12f-af525579ca21 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:33.822373 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-19e03bea-19fc-4db3-b12f-af525579ca21 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:33.822373 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-19e03bea-19fc-4db3-b12f-af525579ca21 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:33.822809 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-19e03bea-19fc-4db3-b12f-af525579ca21 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:33.823273 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-19e03bea-19fc-4db3-b12f-af525579ca21 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:33.823735 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-19e03bea-19fc-4db3-b12f-af525579ca21 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:33.907518 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-19e03bea-19fc-4db3-b12f-af525579ca21 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lazy-loading 'services' on Instance uuid b330121b-dab2-4dbd-bf91-b0fd44ffcb84 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:26:34.134027 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-19e03bea-19fc-4db3-b12f-af525579ca21 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments/8a5dbf66-a87e-4ead-812a-de567ba4bd8f" status: 202 len: 0 microversion: 2.1 time: 0.324867 Aug 18 12:26:34.134632 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 335/679] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:26:33 2022] DELETE /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments/8a5dbf66-a87e-4ead-812a-de567ba4bd8f => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:26:35.307680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e17393e3-0512-4b59-9987-52b53878a7da tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:35.309959 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e17393e3-0512-4b59-9987-52b53878a7da tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:35.316545 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e17393e3-0512-4b59-9987-52b53878a7da tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:35.317028 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e17393e3-0512-4b59-9987-52b53878a7da tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:35.317467 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e17393e3-0512-4b59-9987-52b53878a7da tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:35.318232 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e17393e3-0512-4b59-9987-52b53878a7da tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:35.318687 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e17393e3-0512-4b59-9987-52b53878a7da tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:35.319112 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e17393e3-0512-4b59-9987-52b53878a7da tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:35.349085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e17393e3-0512-4b59-9987-52b53878a7da tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046134 Aug 18 12:26:35.349631 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 345/680] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:26:35 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 12:26:35.483943 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-009686a7-9c5e-4db1-a30a-d9c9cfa8f284 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:35.486149 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-009686a7-9c5e-4db1-a30a-d9c9cfa8f284 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:35.492295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-009686a7-9c5e-4db1-a30a-d9c9cfa8f284 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:35.492770 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-009686a7-9c5e-4db1-a30a-d9c9cfa8f284 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:35.493201 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-009686a7-9c5e-4db1-a30a-d9c9cfa8f284 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:35.493993 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-009686a7-9c5e-4db1-a30a-d9c9cfa8f284 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:35.494980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-009686a7-9c5e-4db1-a30a-d9c9cfa8f284 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:35.495427 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-009686a7-9c5e-4db1-a30a-d9c9cfa8f284 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:35.527073 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-009686a7-9c5e-4db1-a30a-d9c9cfa8f284 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049088 Aug 18 12:26:35.531341 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 336/681] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:26:35 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 12:26:35.595015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d65c280f-e75f-4f4f-87e2-6eb77263197a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:35.595593 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d65c280f-e75f-4f4f-87e2-6eb77263197a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:35.602015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d65c280f-e75f-4f4f-87e2-6eb77263197a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:35.602525 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d65c280f-e75f-4f4f-87e2-6eb77263197a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:35.602958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d65c280f-e75f-4f4f-87e2-6eb77263197a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:35.604179 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d65c280f-e75f-4f4f-87e2-6eb77263197a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:35.604631 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d65c280f-e75f-4f4f-87e2-6eb77263197a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:35.605087 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d65c280f-e75f-4f4f-87e2-6eb77263197a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:35.631873 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d65c280f-e75f-4f4f-87e2-6eb77263197a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:26:35.925004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d65c280f-e75f-4f4f-87e2-6eb77263197a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 204 len: 0 microversion: 2.1 time: 0.333519 Aug 18 12:26:35.925718 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 346/682] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:26:35 2022] DELETE /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:26:35.933789 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-30d03d3c-b7ce-4599-bf84-a125751dc3e8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:35.934399 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-30d03d3c-b7ce-4599-bf84-a125751dc3e8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:35.940884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-30d03d3c-b7ce-4599-bf84-a125751dc3e8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:35.941365 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-30d03d3c-b7ce-4599-bf84-a125751dc3e8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:35.941815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-30d03d3c-b7ce-4599-bf84-a125751dc3e8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:35.942529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-30d03d3c-b7ce-4599-bf84-a125751dc3e8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:35.943009 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-30d03d3c-b7ce-4599-bf84-a125751dc3e8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:35.943467 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-30d03d3c-b7ce-4599-bf84-a125751dc3e8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:36.077327 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-30d03d3c-b7ce-4599-bf84-a125751dc3e8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:36.085322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-30d03d3c-b7ce-4599-bf84-a125751dc3e8 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1675 microversion: 2.1 time: 0.155297 Aug 18 12:26:36.088099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 337/683] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:35 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:37.109461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-33df79de-7fde-4cab-8852-6c82d08f9681 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:37.110154 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-33df79de-7fde-4cab-8852-6c82d08f9681 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:37.116863 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33df79de-7fde-4cab-8852-6c82d08f9681 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:37.117351 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33df79de-7fde-4cab-8852-6c82d08f9681 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:37.117813 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33df79de-7fde-4cab-8852-6c82d08f9681 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:37.118509 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33df79de-7fde-4cab-8852-6c82d08f9681 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:37.119699 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33df79de-7fde-4cab-8852-6c82d08f9681 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:37.120135 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33df79de-7fde-4cab-8852-6c82d08f9681 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:37.253213 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-33df79de-7fde-4cab-8852-6c82d08f9681 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:37.261315 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-33df79de-7fde-4cab-8852-6c82d08f9681 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1675 microversion: 2.1 time: 0.156307 Aug 18 12:26:37.261878 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 347/684] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:37 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:38.284821 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d2714be7-cc5a-4aef-af02-15ca6b2383e3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:38.285544 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d2714be7-cc5a-4aef-af02-15ca6b2383e3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:38.293021 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d2714be7-cc5a-4aef-af02-15ca6b2383e3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:38.293511 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d2714be7-cc5a-4aef-af02-15ca6b2383e3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:38.293951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d2714be7-cc5a-4aef-af02-15ca6b2383e3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:38.294662 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d2714be7-cc5a-4aef-af02-15ca6b2383e3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:38.295128 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d2714be7-cc5a-4aef-af02-15ca6b2383e3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:38.295742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d2714be7-cc5a-4aef-af02-15ca6b2383e3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:38.434777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d2714be7-cc5a-4aef-af02-15ca6b2383e3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:38.442232 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d2714be7-cc5a-4aef-af02-15ca6b2383e3 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1675 microversion: 2.1 time: 0.161396 Aug 18 12:26:38.442788 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 338/685] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:38 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:39.094320 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-7722913f-bca7-4112-a843-90819902d379 req-979a046d-343b-40e0-b6f2-af3fa6bacd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b330121b-dab2-4dbd-bf91-b0fd44ffcb84", "name": "network-vif-deleted", "tag": "7a83416b-9bd1-4e3d-bc38-21475e6e5859"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:39.100144 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-7722913f-bca7-4112-a843-90819902d379 req-979a046d-343b-40e0-b6f2-af3fa6bacd52 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:39.100624 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-7722913f-bca7-4112-a843-90819902d379 req-979a046d-343b-40e0-b6f2-af3fa6bacd52 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:39.101086 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-7722913f-bca7-4112-a843-90819902d379 req-979a046d-343b-40e0-b6f2-af3fa6bacd52 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:39.113312 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-7722913f-bca7-4112-a843-90819902d379 req-979a046d-343b-40e0-b6f2-af3fa6bacd52 service nova] Creating event network-vif-deleted:7a83416b-9bd1-4e3d-bc38-21475e6e5859 for instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 on hv-cinder-83602 Aug 18 12:26:39.118268 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-7722913f-bca7-4112-a843-90819902d379 req-979a046d-343b-40e0-b6f2-af3fa6bacd52 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033456 Aug 18 12:26:39.119655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 348/686] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:39.465684 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:39.466316 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:39.473320 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:39.473850 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:39.474288 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:39.474998 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:39.475475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:39.475905 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:39.508970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:39.509460 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:39.509900 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:39.510345 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lazy-loading 'fault' on Instance uuid b330121b-dab2-4dbd-bf91-b0fd44ffcb84 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:26:39.552844 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5113b1a77fd4b5da175b29b40d2b636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f3e22eb01045f299926f67cd36b91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:39.561121 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-db612ef4-0e3b-4543-9bbb-b014eab689f2 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 200 len: 1327 microversion: 2.1 time: 0.100072 Aug 18 12:26:39.568488 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 339/687] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:39 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:40.583223 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:40.583928 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:40.590262 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:40.590720 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:40.591153 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:40.591883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:40.592337 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:40.592766 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:40.606298 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] HTTP exception thrown: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Request method failure captured: Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 HTTP/1.1 Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i6PVoJY4FFDXrcZklUWOhErg8RtBjjU4Fh-5HwhqH6epf4KEfErOpYqVUjcwmrcVzhmP2lmkzPT_CvnOHsZCFZscHbgPOoWqRRHkjYdYKEZ7MyXPcMsEwEaRfP08iiY-YIxPaOXeJ7Nd6Iwsi_jmHJ7CK39lFFMEl3irHGFEZgwJcM Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:26:40.608202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: b5113b1a77fd4b5da175b29b40d2b636 Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:40.609870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': 'b330121b-dab2-4dbd-bf91-b0fd44ffcb84'} Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:40.610711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:40.612215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:40.613596 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Returning 404 to user: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:40.613596 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1ed7eb1d-56c2-4e73-a348-3b99ecdfabe9 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 404 len: 111 microversion: 2.1 time: 0.031062 Aug 18 12:26:40.613596 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 349/688] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:40 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:26:40.619078 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-604a8943-a4be-441f-a1bc-8ee5dc26dd6b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '.version_select at 0x7f3787ef7e50>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:40.680453 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-604a8943-a4be-441f-a1bc-8ee5dc26dd6b tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084712204" status: 202 len: 0 microversion: 2.1 time: 0.065704 Aug 18 12:26:40.681759 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 340/689] 10.222.0.98 () {58 vars in 1221 bytes} [Thu Aug 18 12:26:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084712204 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:26:43.967263 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:43.967788 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:43.974428 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:43.976234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:43.976234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:43.976234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:43.976501 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:43.976895 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:43.979649 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:44.000227 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] HTTP exception thrown: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Request method failure captured: Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: DELETE /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 HTTP/1.1 Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i6PVoJY4FFDXrcZklUWOhErg8RtBjjU4Fh-5HwhqH6epf4KEfErOpYqVUjcwmrcVzhmP2lmkzPT_CvnOHsZCFZscHbgPOoWqRRHkjYdYKEZ7MyXPcMsEwEaRfP08iiY-YIxPaOXeJ7Nd6Iwsi_jmHJ7CK39lFFMEl3irHGFEZgwJcM Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:26:44.001756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: b5113b1a77fd4b5da175b29b40d2b636 Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:44.003336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': 'b330121b-dab2-4dbd-bf91-b0fd44ffcb84'} Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:44.004432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:44.005988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:44.007543 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Returning 404 to user: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:44.007543 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5b16c931-cb8f-439a-ae2c-7533f1e7ee39 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 404 len: 111 microversion: 2.1 time: 0.040321 Aug 18 12:26:44.007543 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 350/690] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:26:43 2022] DELETE /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:26:44.012933 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:44.013603 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: b330121b-dab2-4dbd-bf91-b0fd44ffcb84] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:44.020348 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:44.020833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:44.021268 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:44.021967 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:44.022418 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:44.022846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:44.035890 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] HTTP exception thrown: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Request method failure captured: Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 HTTP/1.1 Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i6PVoJY4FFDXrcZklUWOhErg8RtBjjU4Fh-5HwhqH6epf4KEfErOpYqVUjcwmrcVzhmP2lmkzPT_CvnOHsZCFZscHbgPOoWqRRHkjYdYKEZ7MyXPcMsEwEaRfP08iiY-YIxPaOXeJ7Nd6Iwsi_jmHJ7CK39lFFMEl3irHGFEZgwJcM Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:26:44.037513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: b5113b1a77fd4b5da175b29b40d2b636 Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:44.039087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': 'b330121b-dab2-4dbd-bf91-b0fd44ffcb84'} Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:44.040428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. Aug 18 12:26:44.041872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:44.043235 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Returning 404 to user: Instance b330121b-dab2-4dbd-bf91-b0fd44ffcb84 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:44.043235 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-13da56de-06b9-4758-ac3d-870d59d6bd33 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84" status: 404 len: 111 microversion: 2.1 time: 0.031155 Aug 18 12:26:44.043235 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 341/691] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:44 2022] GET /compute/v2.1/servers/b330121b-dab2-4dbd-bf91-b0fd44ffcb84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:26:45.336537 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:45.337722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:45.344887 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:45.345364 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:45.345795 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:45.346475 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:45.346920 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:45.347337 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:45.361038 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] HTTP exception thrown: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Request method failure captured: Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: DELETE /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 HTTP/1.1 Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i6PVoJY4FFDXrcZklUWOhErg8RtBjjU4Fh-5HwhqH6epf4KEfErOpYqVUjcwmrcVzhmP2lmkzPT_CvnOHsZCFZscHbgPOoWqRRHkjYdYKEZ7MyXPcMsEwEaRfP08iiY-YIxPaOXeJ7Nd6Iwsi_jmHJ7CK39lFFMEl3irHGFEZgwJcM Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:26:45.362588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: b5113b1a77fd4b5da175b29b40d2b636 Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:26:45.364143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '316b26d0-6178-4b02-8207-e910af024af2'} Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:45.364979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:26:45.366327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:45.372681 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Returning 404 to user: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:45.372681 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7167c596-2987-40c9-bad6-7d82f6d6fc4a tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "DELETE /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 404 len: 111 microversion: 2.1 time: 0.031350 Aug 18 12:26:45.372681 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 351/692] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:26:45 2022] DELETE /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:26:45.372952 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:45.373528 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] [instance: 316b26d0-6178-4b02-8207-e910af024af2] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:45.380184 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:45.380810 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:45.381215 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:45.381926 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:45.382424 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:45.382907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:45.388035 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:45.397594 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] HTTP exception thrown: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Request method failure captured: Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 HTTP/1.1 Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i6PVoJY4FFDXrcZklUWOhErg8RtBjjU4Fh-5HwhqH6epf4KEfErOpYqVUjcwmrcVzhmP2lmkzPT_CvnOHsZCFZscHbgPOoWqRRHkjYdYKEZ7MyXPcMsEwEaRfP08iiY-YIxPaOXeJ7Nd6Iwsi_jmHJ7CK39lFFMEl3irHGFEZgwJcM Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:26:45.399139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b1f3e22eb01045f299926f67cd36b91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: b1f3e22eb01045f299926f67cd36b91d Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1580177295 Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: b5113b1a77fd4b5da175b29b40d2b636 Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeTestJSON-1580177295-project Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:26:45.400783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '316b26d0-6178-4b02-8207-e910af024af2'} Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:45.401664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. Aug 18 12:26:45.403833 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:45.405134 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] Returning 404 to user: Instance 316b26d0-6178-4b02-8207-e910af024af2 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:45.405134 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-507ca912-c991-489c-b40d-a89341533784 tempest-AttachVolumeTestJSON-1580177295 tempest-AttachVolumeTestJSON-1580177295-project] 10.222.0.98 "GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2" status: 404 len: 111 microversion: 2.1 time: 0.031804 Aug 18 12:26:45.405134 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 342/693] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:45 2022] GET /compute/v2.1/servers/316b26d0-6178-4b02-8207-e910af024af2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:26:51.302431 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-99bb2735-888d-4803-b695-6eb244a5cd05 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Action: 'create', calling method: .version_select at 0x7f37989234c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1377367163", "metadata": {"Type": "work"}}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-99bb2735-888d-4803-b695-6eb244a5cd05 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Request method failure captured: Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 122 Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jALkT0hq_qzQRNtA8XknaAIdiSS2YZk8ZQmadC7Em2kLaFT45fu7c4jtYmT9PuTWuH6MnEokftHBrTHU97zG7Ru3dAfrjr_e41HFfp5_7DLgjO7LSTTSTYqE0YpaB3BG4-vI8Tw_ckOxiErgcVErdfMS0VyEFPbpRFe2N9Z6deXNxg Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:26:51.313860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5218505298ee478281862c26f50168e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5218505298ee478281862c26f50168e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: dcd459306c854e80a4bbe0d40f5ae75c Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1377367163", "metadata": {"Type": "work"}}} Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: Aug 18 12:26:51.315447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1377367163', 'metadata': {'Type': 'work'}}}} Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise error Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi '#$%' Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:51.316460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 12:26:51.318046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 12:26:51.319461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 12:26:51.319461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.319461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-99bb2735-888d-4803-b695-6eb244a5cd05 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:51.319461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-99bb2735-888d-4803-b695-6eb244a5cd05 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131140 Aug 18 12:26:51.319461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 352/694] 10.222.0.98 () {60 vars in 1156 bytes} [Thu Aug 18 12:26:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 12:26:51.325242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3eaac923-0a83-41d8-9d5e-63ca15783d1b tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Action: 'create', calling method: .version_select at 0x7f3787ed5670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1358690966", "metadata": {"Type": "work"}}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3eaac923-0a83-41d8-9d5e-63ca15783d1b tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Request method failure captured: Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 120 Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jALkT0hq_qzQRNtA8XknaAIdiSS2YZk8ZQmadC7Em2kLaFT45fu7c4jtYmT9PuTWuH6MnEokftHBrTHU97zG7Ru3dAfrjr_e41HFfp5_7DLgjO7LSTTSTYqE0YpaB3BG4-vI8Tw_ckOxiErgcVErdfMS0VyEFPbpRFe2N9Z6deXNxg Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:26:51.329899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5218505298ee478281862c26f50168e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5218505298ee478281862c26f50168e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: dcd459306c854e80a4bbe0d40f5ae75c Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1358690966", "metadata": {"Type": "work"}}} Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: Aug 18 12:26:51.331475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1358690966', 'metadata': {'Type': 'work'}}}} Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise error Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi '0' Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:51.332409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 12:26:51.334158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 12:26:51.335328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 12:26:51.335328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.335328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3eaac923-0a83-41d8-9d5e-63ca15783d1b tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:51.335328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3eaac923-0a83-41d8-9d5e-63ca15783d1b tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009942 Aug 18 12:26:51.335328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 343/695] 10.222.0.98 () {60 vars in 1156 bytes} [Thu Aug 18 12:26:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 12:26:51.340718 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-896cde77-95ef-46f5-aef1-179f32fa5278 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Action: 'create', calling method: .version_select at 0x7f3798920310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1948426034", "metadata": {"Type": "work"}}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-896cde77-95ef-46f5-aef1-179f32fa5278 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Request method failure captured: Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 119 Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jALkT0hq_qzQRNtA8XknaAIdiSS2YZk8ZQmadC7Em2kLaFT45fu7c4jtYmT9PuTWuH6MnEokftHBrTHU97zG7Ru3dAfrjr_e41HFfp5_7DLgjO7LSTTSTYqE0YpaB3BG4-vI8Tw_ckOxiErgcVErdfMS0VyEFPbpRFe2N9Z6deXNxg Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:26:51.345245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5218505298ee478281862c26f50168e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5218505298ee478281862c26f50168e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: dcd459306c854e80a4bbe0d40f5ae75c Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1948426034", "metadata": {"Type": "work"}}} Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: Aug 18 12:26:51.346781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1948426034', 'metadata': {'Type': 'work'}}}} Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise error Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi '' Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:51.347778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 12:26:51.349369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 12:26:51.350767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 12:26:51.350767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.350767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-896cde77-95ef-46f5-aef1-179f32fa5278 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:51.350767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-896cde77-95ef-46f5-aef1-179f32fa5278 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009929 Aug 18 12:26:51.350767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 353/696] 10.222.0.98 () {60 vars in 1156 bytes} [Thu Aug 18 12:26:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 12:26:51.358274 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e316111d-cea0-4ef5-9ee6-02cec30826f7 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Calling method '.version_select at 0x7f3787e69a60>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:51.389744 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-e316111d-cea0-4ef5-9ee6-02cec30826f7 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] HTTP exception thrown: Volume tempest-invalid-1358691016 could not be found. Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e316111d-cea0-4ef5-9ee6-02cec30826f7 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Request method failure captured: Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1358691016 HTTP/1.1 Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jALkT0hq_qzQRNtA8XknaAIdiSS2YZk8ZQmadC7Em2kLaFT45fu7c4jtYmT9PuTWuH6MnEokftHBrTHU97zG7Ru3dAfrjr_e41HFfp5_7DLgjO7LSTTSTYqE0YpaB3BG4-vI8Tw_ckOxiErgcVErdfMS0VyEFPbpRFe2N9Z6deXNxg Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:26:51.391988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5218505298ee478281862c26f50168e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5218505298ee478281862c26f50168e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: dcd459306c854e80a4bbe0d40f5ae75c Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Volume tempest-invalid-1358691016 could not be found. Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': 'tempest-invalid-1358691016'} Aug 18 12:26:51.393570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1358691016 could not be found. (HTTP 404) (Request-ID: req-454d9f91-013a-4ff5-b3fb-7c14e7458139) Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.394557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 12:26:51.396141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1358691016 could not be found. Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:26:51.397289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1358691016 could not be found. Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1358691016 could not be found. Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e316111d-cea0-4ef5-9ee6-02cec30826f7 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Returning 404 to user: Volume tempest-invalid-1358691016 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e316111d-cea0-4ef5-9ee6-02cec30826f7 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1358691016" status: 404 len: 99 microversion: 2.1 time: 0.040727 Aug 18 12:26:51.398742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 344/697] 10.222.0.98 () {58 vars in 1218 bytes} [Thu Aug 18 12:26:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1358691016 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 12:26:51.403927 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b50309f8-6f87-4875-9fde-df827cb6bac5 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004249 Aug 18 12:26:51.404423 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 354/698] 10.222.0.98 () {58 vars in 1140 bytes} [Thu Aug 18 12:26:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 12:26:51.413317 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2eb6ea7a-2ff7-458a-9e7d-29fe1dd059ca tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004116 Aug 18 12:26:51.413834 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 345/699] 10.222.0.98 () {58 vars in 1137 bytes} [Thu Aug 18 12:26:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 12:26:51.422662 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8963af87-f185-4564-a29e-c539381f83cb tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Calling method '.version_select at 0x7f379406f670>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:51.451642 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-8963af87-f185-4564-a29e-c539381f83cb tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] HTTP exception thrown: Volume af88def0-1e7e-454e-a75d-b5f2b6926182 could not be found. Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8963af87-f185-4564-a29e-c539381f83cb tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Request method failure captured: Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: DELETE /compute/v2.1/os-volumes/af88def0-1e7e-454e-a75d-b5f2b6926182 HTTP/1.1 Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jALkT0hq_qzQRNtA8XknaAIdiSS2YZk8ZQmadC7Em2kLaFT45fu7c4jtYmT9PuTWuH6MnEokftHBrTHU97zG7Ru3dAfrjr_e41HFfp5_7DLgjO7LSTTSTYqE0YpaB3BG4-vI8Tw_ckOxiErgcVErdfMS0VyEFPbpRFe2N9Z6deXNxg Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:26:51.454909 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5218505298ee478281862c26f50168e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5218505298ee478281862c26f50168e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: dcd459306c854e80a4bbe0d40f5ae75c Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Volume af88def0-1e7e-454e-a75d-b5f2b6926182 could not be found. Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': 'af88def0-1e7e-454e-a75d-b5f2b6926182'} Aug 18 12:26:51.456832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af88def0-1e7e-454e-a75d-b5f2b6926182 could not be found. (HTTP 404) (Request-ID: req-5d804b8c-d19f-4543-a58f-63c51ee85e6b) Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.457799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 12:26:51.459151 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af88def0-1e7e-454e-a75d-b5f2b6926182 could not be found. Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 12:26:51.460397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af88def0-1e7e-454e-a75d-b5f2b6926182 could not be found. Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af88def0-1e7e-454e-a75d-b5f2b6926182 could not be found. Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8963af87-f185-4564-a29e-c539381f83cb tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Returning 404 to user: Volume af88def0-1e7e-454e-a75d-b5f2b6926182 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8963af87-f185-4564-a29e-c539381f83cb tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/af88def0-1e7e-454e-a75d-b5f2b6926182" status: 404 len: 109 microversion: 2.1 time: 0.037395 Aug 18 12:26:51.461803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 355/700] 10.222.0.98 () {58 vars in 1248 bytes} [Thu Aug 18 12:26:51 2022] DELETE /compute/v2.1/os-volumes/af88def0-1e7e-454e-a75d-b5f2b6926182 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:26:51.466519 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-232165d0-1048-4b8f-ad0b-c1f1141aa148 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Calling method '.version_select at 0x7f3787ea3160>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:51.494177 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-232165d0-1048-4b8f-ad0b-c1f1141aa148 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] HTTP exception thrown: Volume 40fed9d0-f5a7-44f1-be9b-38c3c875262d could not be found. Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-232165d0-1048-4b8f-ad0b-c1f1141aa148 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Request method failure captured: Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/os-volumes/40fed9d0-f5a7-44f1-be9b-38c3c875262d HTTP/1.1 Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jALkT0hq_qzQRNtA8XknaAIdiSS2YZk8ZQmadC7Em2kLaFT45fu7c4jtYmT9PuTWuH6MnEokftHBrTHU97zG7Ru3dAfrjr_e41HFfp5_7DLgjO7LSTTSTYqE0YpaB3BG4-vI8Tw_ckOxiErgcVErdfMS0VyEFPbpRFe2N9Z6deXNxg Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:26:51.496214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5218505298ee478281862c26f50168e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5218505298ee478281862c26f50168e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5218505298ee478281862c26f50168e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 5218505298ee478281862c26f50168e2 Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-VolumesNegativeTest-1794672845 Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: dcd459306c854e80a4bbe0d40f5ae75c Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-VolumesNegativeTest-1794672845-project Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Volume 40fed9d0-f5a7-44f1-be9b-38c3c875262d could not be found. Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '40fed9d0-f5a7-44f1-be9b-38c3c875262d'} Aug 18 12:26:51.497781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40fed9d0-f5a7-44f1-be9b-38c3c875262d could not be found. (HTTP 404) (Request-ID: req-8174ae52-88e7-4c47-b745-b406e1417360) Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.500451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:26:51.501714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40fed9d0-f5a7-44f1-be9b-38c3c875262d could not be found. Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 12:26:51.503061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40fed9d0-f5a7-44f1-be9b-38c3c875262d could not be found. Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40fed9d0-f5a7-44f1-be9b-38c3c875262d could not be found. Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-232165d0-1048-4b8f-ad0b-c1f1141aa148 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] Returning 404 to user: Volume 40fed9d0-f5a7-44f1-be9b-38c3c875262d could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-232165d0-1048-4b8f-ad0b-c1f1141aa148 tempest-VolumesNegativeTest-1794672845 tempest-VolumesNegativeTest-1794672845-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/40fed9d0-f5a7-44f1-be9b-38c3c875262d" status: 404 len: 109 microversion: 2.1 time: 0.035537 Aug 18 12:26:51.504472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 346/701] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:26:51 2022] GET /compute/v2.1/os-volumes/40fed9d0-f5a7-44f1-be9b-38c3c875262d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:26:55.526057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:55.530865 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5cbeb9d6-fd1f-44f9-a52a-99afb547dd77 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:55.531352 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5cbeb9d6-fd1f-44f9-a52a-99afb547dd77 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:55.537205 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cbeb9d6-fd1f-44f9-a52a-99afb547dd77 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:55.537696 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cbeb9d6-fd1f-44f9-a52a-99afb547dd77 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:55.538136 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cbeb9d6-fd1f-44f9-a52a-99afb547dd77 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:55.538830 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cbeb9d6-fd1f-44f9-a52a-99afb547dd77 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:55.539286 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cbeb9d6-fd1f-44f9-a52a-99afb547dd77 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:55.539739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5cbeb9d6-fd1f-44f9-a52a-99afb547dd77 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:55.564525 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5cbeb9d6-fd1f-44f9-a52a-99afb547dd77 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/ips" status: 200 len: 151 microversion: 2.20 time: 0.039638 Aug 18 12:26:55.565200 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 356/702] 10.222.0.98 () {60 vars in 1289 bytes} [Thu Aug 18 12:26:55 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:26:59.920005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:59.925298 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f147064e-4600-4cd1-8632-7d965d8d5644 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:59.926708 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f147064e-4600-4cd1-8632-7d965d8d5644 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:59.932074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f147064e-4600-4cd1-8632-7d965d8d5644 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:59.932561 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f147064e-4600-4cd1-8632-7d965d8d5644 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:59.933020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f147064e-4600-4cd1-8632-7d965d8d5644 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:59.933727 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f147064e-4600-4cd1-8632-7d965d8d5644 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:59.934175 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f147064e-4600-4cd1-8632-7d965d8d5644 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:59.934683 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f147064e-4600-4cd1-8632-7d965d8d5644 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:59.958852 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-f147064e-4600-4cd1-8632-7d965d8d5644 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lazy-loading 'flavor' on Instance uuid 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:27:00.491884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f147064e-4600-4cd1-8632-7d965d8d5644 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "POST /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/action" status: 202 len: 0 microversion: 2.20 time: 0.573457 Aug 18 12:27:00.492476 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 347/703] 10.222.0.98 () {62 vars in 1319 bytes} [Thu Aug 18 12:26:59 2022] POST /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:27:00.501321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:00.503047 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:00.509007 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:00.509473 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:00.509912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:00.510605 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:00.511057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:00.512075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:00.656713 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:00.665131 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:00.666657 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:00.667843 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8c69bcf6-ac81-43cb-b6e6-b88e83e1ecbc tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.170407 Aug 18 12:27:00.668402 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 357/704] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:00 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:27:01.691513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:01.692794 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:01.700359 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:01.701352 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:01.701352 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:01.702141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:01.702655 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:01.703026 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:01.838455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:01.847257 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:01.849060 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:01.850229 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2963e684-d848-48d2-a693-5e929a244289 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.163971 Aug 18 12:27:01.850945 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 348/705] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:01 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:02.873119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:02.873730 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:02.880611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:02.881101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:02.881530 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:02.882222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:02.882673 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:02.883096 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:03.022235 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:03.031330 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:03.033002 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:03.034258 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ff8549a9-045f-44b4-a530-c11b86f38577 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.165006 Aug 18 12:27:03.034822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 358/706] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:02 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:04.056899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:04.057506 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:04.064574 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:04.065054 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:04.065488 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:04.066186 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:04.066631 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:04.067055 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:04.212123 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:04.220923 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:04.222750 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:04.224331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3522603b-d3d2-4833-ba59-a828b4c30f1e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.171497 Aug 18 12:27:04.225168 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 349/707] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:04 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:05.248434 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:05.248995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:05.255436 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:05.255914 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:05.256342 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:05.257018 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:05.257461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:05.257874 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:05.385818 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:05.394794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:05.396358 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:05.397546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2a9697d3-5a6f-4074-a222-f6923046633b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.153038 Aug 18 12:27:05.398105 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 359/708] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:05 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:06.421387 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:06.422002 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:06.428436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:06.428954 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:06.429389 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:06.430093 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:06.430542 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:06.430968 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:06.576218 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:06.584431 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:06.585953 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:06.587128 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e4d5a407-6eae-4149-aa44-6a96a096c9ba tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.170208 Aug 18 12:27:06.587995 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 350/709] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:06 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:07.611397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:07.612094 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:07.618939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:07.619454 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:07.619920 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:07.621197 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:07.621648 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:07.622251 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:07.759989 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:07.771133 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:07.773392 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:07.774870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3b01ca2b-6250-40d2-aa15-8871c3235d32 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.167785 Aug 18 12:27:07.775770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 360/710] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:07 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:08.797603 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:08.798199 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:08.806245 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:08.806245 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:08.806245 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:08.806554 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:08.806973 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:08.807445 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:08.947815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:08.956778 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:08.958324 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:08.959444 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-87ac5ed7-b38b-4879-84ca-d82e696181f3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.165807 Aug 18 12:27:08.965004 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 351/711] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:08 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:09.982838 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:09.984147 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:09.990648 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:09.991071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:09.991541 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:09.992231 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:09.992678 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:09.993100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:10.148782 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:10.157590 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:10.159165 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:10.160451 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5399ad8d-dc72-4e55-8053-21d40344dd6a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.182392 Aug 18 12:27:10.161210 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 361/712] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:09 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:11.185052 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:11.185696 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:11.192442 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:11.192939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:11.193461 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:11.194074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:11.194527 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:11.194953 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:11.392460 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:11.401020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:11.402640 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:11.404024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f9a63190-e202-41ee-a804-a2cc6cc03284 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.223640 Aug 18 12:27:11.404668 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 352/713] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:11 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:12.609866 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:12.610505 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:12.616594 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:12.617025 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:12.617460 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:12.618149 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:12.618603 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:12.619030 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:12.783301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:12.791271 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:12.793423 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:12.794591 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-44993621-4020-46ac-ae53-96a253ea46c6 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.369042 Aug 18 12:27:12.795154 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 362/714] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:12 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:13.817482 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:13.819077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:13.830258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:13.831103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:13.831566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:13.832372 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:13.832704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:13.833133 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:13.972957 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:13.985040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:13.987057 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:13.989202 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4dbc8ed2-91c1-4fb4-89ae-77183c51c3ed tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.175648 Aug 18 12:27:13.991882 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 353/715] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:13 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:15.013932 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:15.014574 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:15.021276 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:15.021753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:15.022210 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:15.022892 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:15.023335 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:15.023789 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:15.159526 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:15.167734 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:15.169342 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:15.170587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0c19a49e-d563-43df-8391-44942f8b1d0c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.161063 Aug 18 12:27:15.171143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 363/716] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:15 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:16.194244 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:16.194926 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:16.202800 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:16.202800 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:16.203756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:16.204047 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:16.205243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:16.205243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:16.342801 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:16.351074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:16.352625 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:16.353783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c90a20f1-26e6-4358-aadd-45bf577f45d1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.164366 Aug 18 12:27:16.354363 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 354/717] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:16 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:17.377362 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:17.377887 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:17.384337 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:17.384820 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:17.385254 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:17.385942 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:17.386948 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:17.387372 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:17.515844 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:17.523733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:17.525248 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:17.526423 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0af70af1-2e84-4180-9795-8461a8701237 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.152995 Aug 18 12:27:17.527629 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 364/718] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:17 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:18.549234 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:18.549759 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:18.556242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:18.556736 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:18.557153 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:18.558336 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:18.558792 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:18.559214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:18.688355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:18.696702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:18.698253 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:18.700044 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-13d1864b-eabd-4eae-89f4-d6718d0f4e2b tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.154799 Aug 18 12:27:18.700598 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 355/719] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:18 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:19.722357 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:19.722959 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:19.729137 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:19.734387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:19.734387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:19.734387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:19.734387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:19.734759 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:19.864831 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:19.872808 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:19.874303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:19.875462 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-846818c0-e9f0-4368-af5e-80e437fc97b1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.157162 Aug 18 12:27:19.876004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 365/720] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:19 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:20.186270 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1012902191", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "networks": [{"uuid": "fac57b00-9eb9-426b-9f5b-54198cd083f4"}]}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:20.240474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] validate_networks() for [('fac57b00-9eb9-426b-9f5b-54198cd083f4', None, None, None, None, None)] {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:27:20.599879 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:27:20.600307 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:27:20.600785 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:27:20.601198 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:27:20.601614 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:27:20.611341 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:20.611857 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:20.612302 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:20.613027 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:20.613487 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:20.613913 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:20.635440 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Getting quotas for project 672f308b487a4c0bb2d3e731542289cf. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:27:20.635440 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Getting quotas for user cb91581b839c4318a1bb6c53e63f2649 and project 672f308b487a4c0bb2d3e731542289cf. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:27:20.645369 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:27:20.647677 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:27:20.776192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-7b6e30e1-c4bb-487b-9726-5d1375ce1457 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594581 Aug 18 12:27:20.776838 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 356/721] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:27:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:27:20.788284 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f5f3591a-2844-4173-b72d-0aa1092f8e1e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:20.788896 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f5f3591a-2844-4173-b72d-0aa1092f8e1e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:20.845371 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f5f3591a-2844-4173-b72d-0aa1092f8e1e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:20.852340 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f5f3591a-2844-4173-b72d-0aa1092f8e1e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1214 microversion: 2.1 time: 0.068103 Aug 18 12:27:20.852946 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 366/722] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:20 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:20.897875 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:20.899152 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:20.905197 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:20.905685 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:20.906126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:20.906827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:20.907283 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:20.907740 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:21.041212 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:21.049215 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:21.050757 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:21.051955 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ab61fa38-549e-4dd3-927c-7a3a73b694a4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.158183 Aug 18 12:27:21.052508 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 357/723] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:20 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:21.874229 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-40170120-c348-4f13-bdad-60c7bce43173 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:21.874877 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-40170120-c348-4f13-bdad-60c7bce43173 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:21.927606 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-40170120-c348-4f13-bdad-60c7bce43173 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:21.934533 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-40170120-c348-4f13-bdad-60c7bce43173 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1214 microversion: 2.1 time: 0.064644 Aug 18 12:27:21.935739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 367/724] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:21 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:22.074257 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:22.074801 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:22.081583 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:22.082074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:22.082519 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:22.083224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:22.083707 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:22.084137 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:22.088585 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:22.223757 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:22.233981 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:22.235531 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:22.238416 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-9472d73c-1f2c-4988-b3c0-b37d60900b7f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1743 microversion: 2.20 time: 0.166443 Aug 18 12:27:22.238416 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 358/725] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:22 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:22.956490 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4dc11521-a2dd-47b3-b31b-018d93522641 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:22.957264 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-4dc11521-a2dd-47b3-b31b-018d93522641 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:22.964238 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dc11521-a2dd-47b3-b31b-018d93522641 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:22.964238 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dc11521-a2dd-47b3-b31b-018d93522641 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:22.964508 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dc11521-a2dd-47b3-b31b-018d93522641 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:22.965210 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dc11521-a2dd-47b3-b31b-018d93522641 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:22.965657 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dc11521-a2dd-47b3-b31b-018d93522641 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:22.966077 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dc11521-a2dd-47b3-b31b-018d93522641 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:22.970119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=62 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:23.034046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-4dc11521-a2dd-47b3-b31b-018d93522641 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:23.041355 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4dc11521-a2dd-47b3-b31b-018d93522641 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1266 microversion: 2.1 time: 0.088897 Aug 18 12:27:23.043227 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 368/726] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:22 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:23.259768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:23.260382 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:23.267670 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:23.268160 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:23.268790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:23.269528 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:23.270158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:23.270587 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:23.416219 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:23.426092 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:23.427650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:23.428800 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d0b29e6e-2a93-4927-8f1c-c97aeaede2d2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1743 microversion: 2.20 time: 0.173009 Aug 18 12:27:23.429341 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 359/727] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:23 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:27:23.882284 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-321bbe9d-1e2b-4d7d-b9a5-21a5df449cfa req-bc79df3b-0c09-463f-ac19-827dd2ee774a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f0a98d-091a-4d0c-8e84-79fbb60d71a8", "name": "network-vif-plugged", "status": "completed", "tag": "5ed6bae6-8e44-4797-93ff-eaa620fb9744"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:23.894821 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-321bbe9d-1e2b-4d7d-b9a5-21a5df449cfa req-bc79df3b-0c09-463f-ac19-827dd2ee774a service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:23.895461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-321bbe9d-1e2b-4d7d-b9a5-21a5df449cfa req-bc79df3b-0c09-463f-ac19-827dd2ee774a service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:23.896106 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-321bbe9d-1e2b-4d7d-b9a5-21a5df449cfa req-bc79df3b-0c09-463f-ac19-827dd2ee774a service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:23.908303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-321bbe9d-1e2b-4d7d-b9a5-21a5df449cfa req-bc79df3b-0c09-463f-ac19-827dd2ee774a service nova] Creating event network-vif-plugged:5ed6bae6-8e44-4797-93ff-eaa620fb9744 for instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 on hv-cinder-83602 Aug 18 12:27:23.913680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-321bbe9d-1e2b-4d7d-b9a5-21a5df449cfa req-bc79df3b-0c09-463f-ac19-827dd2ee774a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037848 Aug 18 12:27:23.914907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 369/728] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:27:24.062380 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-fd2c4df7-a007-4464-a546-5bd19f7fe6ea tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:24.063225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-fd2c4df7-a007-4464-a546-5bd19f7fe6ea tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:24.072326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd2c4df7-a007-4464-a546-5bd19f7fe6ea tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:24.072809 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd2c4df7-a007-4464-a546-5bd19f7fe6ea tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:24.073695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd2c4df7-a007-4464-a546-5bd19f7fe6ea tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:24.075294 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd2c4df7-a007-4464-a546-5bd19f7fe6ea tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:24.076649 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd2c4df7-a007-4464-a546-5bd19f7fe6ea tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:24.077304 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fd2c4df7-a007-4464-a546-5bd19f7fe6ea tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:24.249244 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-fd2c4df7-a007-4464-a546-5bd19f7fe6ea tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:24.258534 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-fd2c4df7-a007-4464-a546-5bd19f7fe6ea tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1314 microversion: 2.1 time: 0.199860 Aug 18 12:27:24.259143 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 360/729] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:24 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:24.455119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:24.467569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:24.467569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:24.467569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:24.467569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:24.467956 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:24.467956 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:24.467956 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:24.705583 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:24.717310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:24.719176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:24.720806 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-67e11a58-eeb9-40b9-87db-47d38b7345e3 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1738 microversion: 2.20 time: 0.271420 Aug 18 12:27:24.721604 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 370/730] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:24 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:25.104622 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-a9506249-3672-4881-842f-51e0a13f439e req-f9ee9eff-bf00-467b-8a8d-96be52c4e3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e41112-3597-4728-87cc-2ea4746a32d6", "tag": "17bf7029-c042-4a17-bcf7-fc95eb6aaa65"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:25.117364 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-a9506249-3672-4881-842f-51e0a13f439e req-f9ee9eff-bf00-467b-8a8d-96be52c4e3ec service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:25.118142 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-a9506249-3672-4881-842f-51e0a13f439e req-f9ee9eff-bf00-467b-8a8d-96be52c4e3ec service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:25.118734 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-a9506249-3672-4881-842f-51e0a13f439e req-f9ee9eff-bf00-467b-8a8d-96be52c4e3ec service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:25.137250 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-a9506249-3672-4881-842f-51e0a13f439e req-f9ee9eff-bf00-467b-8a8d-96be52c4e3ec service nova] Creating event network-changed:17bf7029-c042-4a17-bcf7-fc95eb6aaa65 for instance 62e41112-3597-4728-87cc-2ea4746a32d6 on hv-cinder-83602 Aug 18 12:27:25.143458 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-a9506249-3672-4881-842f-51e0a13f439e req-f9ee9eff-bf00-467b-8a8d-96be52c4e3ec service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042834 Aug 18 12:27:25.144611 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 361/731] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:27:25.280731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-27d89bfc-dfb6-4dd4-a308-297f598d29d7 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:25.281531 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-27d89bfc-dfb6-4dd4-a308-297f598d29d7 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:25.292346 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27d89bfc-dfb6-4dd4-a308-297f598d29d7 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:25.293236 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27d89bfc-dfb6-4dd4-a308-297f598d29d7 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:25.293887 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27d89bfc-dfb6-4dd4-a308-297f598d29d7 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:25.296305 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27d89bfc-dfb6-4dd4-a308-297f598d29d7 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:25.299354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27d89bfc-dfb6-4dd4-a308-297f598d29d7 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:25.300029 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27d89bfc-dfb6-4dd4-a308-297f598d29d7 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:25.535177 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-27d89bfc-dfb6-4dd4-a308-297f598d29d7 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:25.557205 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-27d89bfc-dfb6-4dd4-a308-297f598d29d7 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1314 microversion: 2.1 time: 0.272034 Aug 18 12:27:25.557205 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 371/732] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:25 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:25.746026 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:25.746813 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:25.753884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:25.754382 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:25.755018 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:25.755667 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:25.756007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:25.756430 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:25.923873 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:25.932831 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:25.934600 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:25.936573 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-466e8005-841b-4c72-b57f-91c0c71f28a7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1738 microversion: 2.20 time: 0.194766 Aug 18 12:27:25.937203 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 362/733] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:25 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:26.579580 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5a7794de-c9e3-41e5-8186-50ed0b3e2feb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:26.581167 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5a7794de-c9e3-41e5-8186-50ed0b3e2feb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:26.589265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5a7794de-c9e3-41e5-8186-50ed0b3e2feb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:26.590024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5a7794de-c9e3-41e5-8186-50ed0b3e2feb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:26.593252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5a7794de-c9e3-41e5-8186-50ed0b3e2feb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:26.594207 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5a7794de-c9e3-41e5-8186-50ed0b3e2feb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:26.595245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5a7794de-c9e3-41e5-8186-50ed0b3e2feb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:26.595245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5a7794de-c9e3-41e5-8186-50ed0b3e2feb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:26.764430 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5a7794de-c9e3-41e5-8186-50ed0b3e2feb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:26.775545 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5a7794de-c9e3-41e5-8186-50ed0b3e2feb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1314 microversion: 2.1 time: 0.202785 Aug 18 12:27:26.776688 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 372/734] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:26 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:26.962047 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:26.963390 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:26.973228 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:26.973983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:26.974416 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:26.975301 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:26.975811 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:26.976234 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:27.159241 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:27.169018 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:27.170764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:27.172008 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3913f22b-9f44-4952-8031-23ec918dbc08 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1738 microversion: 2.20 time: 0.213837 Aug 18 12:27:27.183503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 363/735] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:26 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:27.798094 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bb7d8c58-4aa6-43bd-a5dc-9807ca845253 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:27.798717 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bb7d8c58-4aa6-43bd-a5dc-9807ca845253 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:27.805376 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb7d8c58-4aa6-43bd-a5dc-9807ca845253 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:27.805859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb7d8c58-4aa6-43bd-a5dc-9807ca845253 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:27.806432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb7d8c58-4aa6-43bd-a5dc-9807ca845253 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:27.807160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb7d8c58-4aa6-43bd-a5dc-9807ca845253 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:27.807692 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb7d8c58-4aa6-43bd-a5dc-9807ca845253 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:27.808110 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb7d8c58-4aa6-43bd-a5dc-9807ca845253 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:27.942545 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-bb7d8c58-4aa6-43bd-a5dc-9807ca845253 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:27.949956 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-bb7d8c58-4aa6-43bd-a5dc-9807ca845253 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1314 microversion: 2.1 time: 0.156343 Aug 18 12:27:27.950542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 373/736] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:27 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:28.199115 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:28.200378 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:28.206793 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:28.207271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:28.207735 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:28.208597 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:28.209171 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:28.209784 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:28.353702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:28.366262 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:28.369936 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:28.372714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-66a55e33-202d-42e2-a01b-7dbf7c82f483 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1738 microversion: 2.20 time: 0.177801 Aug 18 12:27:28.374260 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 364/737] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:28 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:28.970415 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a224e2db-f39c-47de-84e1-14ac51cafccb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:28.971721 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a224e2db-f39c-47de-84e1-14ac51cafccb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:28.979922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a224e2db-f39c-47de-84e1-14ac51cafccb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:28.983693 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a224e2db-f39c-47de-84e1-14ac51cafccb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:28.987145 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a224e2db-f39c-47de-84e1-14ac51cafccb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:28.988349 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a224e2db-f39c-47de-84e1-14ac51cafccb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:28.988926 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a224e2db-f39c-47de-84e1-14ac51cafccb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:28.989467 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a224e2db-f39c-47de-84e1-14ac51cafccb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:29.145600 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a224e2db-f39c-47de-84e1-14ac51cafccb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:29.153616 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a224e2db-f39c-47de-84e1-14ac51cafccb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1314 microversion: 2.1 time: 0.186924 Aug 18 12:27:29.154817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 374/738] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:28 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:29.402585 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:29.403230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:29.409765 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:29.410243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:29.410675 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:29.411370 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:29.411827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:29.412243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:29.564381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:29.573677 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:29.576020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:29.577154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0b7969a5-e8c5-4f9c-8fe2-ea313aeea5da tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1738 microversion: 2.20 time: 0.181083 Aug 18 12:27:29.577914 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 365/739] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:29 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:29.989859 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-08310acc-e935-4035-b569-01693bf29f4b req-d6877e70-3870-4435-bd6f-3dcd8d3f9832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e41112-3597-4728-87cc-2ea4746a32d6", "name": "network-vif-plugged", "status": "completed", "tag": "17bf7029-c042-4a17-bcf7-fc95eb6aaa65"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:30.004828 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-08310acc-e935-4035-b569-01693bf29f4b req-d6877e70-3870-4435-bd6f-3dcd8d3f9832 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:30.005510 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-08310acc-e935-4035-b569-01693bf29f4b req-d6877e70-3870-4435-bd6f-3dcd8d3f9832 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:30.006035 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-08310acc-e935-4035-b569-01693bf29f4b req-d6877e70-3870-4435-bd6f-3dcd8d3f9832 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:30.018674 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-08310acc-e935-4035-b569-01693bf29f4b req-d6877e70-3870-4435-bd6f-3dcd8d3f9832 service nova] Creating event network-vif-plugged:17bf7029-c042-4a17-bcf7-fc95eb6aaa65 for instance 62e41112-3597-4728-87cc-2ea4746a32d6 on hv-cinder-83602 Aug 18 12:27:30.026257 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-08310acc-e935-4035-b569-01693bf29f4b req-d6877e70-3870-4435-bd6f-3dcd8d3f9832 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040032 Aug 18 12:27:30.027010 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 375/740] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:27:30.180996 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4175b347-d79e-4ccc-baac-c487beae88cd tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:30.181869 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4175b347-d79e-4ccc-baac-c487beae88cd tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:30.184085 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:30.193878 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4175b347-d79e-4ccc-baac-c487beae88cd tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:30.194624 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4175b347-d79e-4ccc-baac-c487beae88cd tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:30.195244 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4175b347-d79e-4ccc-baac-c487beae88cd tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:30.196165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4175b347-d79e-4ccc-baac-c487beae88cd tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:30.196775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4175b347-d79e-4ccc-baac-c487beae88cd tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:30.197355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4175b347-d79e-4ccc-baac-c487beae88cd tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:30.368396 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4175b347-d79e-4ccc-baac-c487beae88cd tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:30.381782 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4175b347-d79e-4ccc-baac-c487beae88cd tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1314 microversion: 2.1 time: 0.205515 Aug 18 12:27:30.382376 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 366/741] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:30 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:30.601968 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:30.605864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:30.610499 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:30.611197 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:30.611676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:30.612371 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:30.613037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:30.613457 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:30.783854 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:30.795464 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:30.797995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:30.799957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-dd29a6ca-57cd-44e2-96f2-449c460d8f61 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1738 microversion: 2.20 time: 0.203468 Aug 18 12:27:30.801236 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 376/742] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:30 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:31.402705 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8b6ac55e-dc04-4180-abd3-5a32589ca03f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:31.403383 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8b6ac55e-dc04-4180-abd3-5a32589ca03f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:31.405712 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:31.406410 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=6 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:31.411406 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b6ac55e-dc04-4180-abd3-5a32589ca03f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:31.411917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b6ac55e-dc04-4180-abd3-5a32589ca03f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:31.412350 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b6ac55e-dc04-4180-abd3-5a32589ca03f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:31.413087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b6ac55e-dc04-4180-abd3-5a32589ca03f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:31.413542 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b6ac55e-dc04-4180-abd3-5a32589ca03f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:31.413964 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b6ac55e-dc04-4180-abd3-5a32589ca03f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:31.583627 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8b6ac55e-dc04-4180-abd3-5a32589ca03f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:31.583627 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8b6ac55e-dc04-4180-abd3-5a32589ca03f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1314 microversion: 2.1 time: 0.168013 Aug 18 12:27:31.583627 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 367/743] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:31 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:31.825068 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:31.825679 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:31.833033 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:31.833527 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:31.833950 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:31.834947 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:31.835398 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:31.836078 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:31.932271 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=4 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:32.033558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:32.049280 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:32.051199 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:32.052851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-84f4af2b-3c58-4f0e-b3c1-b7fbe905735d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1738 microversion: 2.20 time: 0.231815 Aug 18 12:27:32.067792 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 377/744] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:31 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:32.590042 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-83a792ad-d98c-41ea-8541-6eb9bad6c77e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:32.591546 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-83a792ad-d98c-41ea-8541-6eb9bad6c77e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:32.599744 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-83a792ad-d98c-41ea-8541-6eb9bad6c77e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:32.600576 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-83a792ad-d98c-41ea-8541-6eb9bad6c77e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:32.601379 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-83a792ad-d98c-41ea-8541-6eb9bad6c77e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:32.602144 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-83a792ad-d98c-41ea-8541-6eb9bad6c77e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:32.602599 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-83a792ad-d98c-41ea-8541-6eb9bad6c77e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:32.603022 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-83a792ad-d98c-41ea-8541-6eb9bad6c77e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:32.753304 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-83a792ad-d98c-41ea-8541-6eb9bad6c77e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:32.762081 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-83a792ad-d98c-41ea-8541-6eb9bad6c77e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1498 microversion: 2.1 time: 0.176661 Aug 18 12:27:32.762650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 368/745] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:32 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:33.078646 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:33.079924 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:33.082304 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=49 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:33.087310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:33.087821 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:33.089558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:33.090327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:33.090778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:33.091233 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:33.336558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:33.348006 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:33.350915 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:33.353906 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2d5bacb6-db35-49ae-a6b6-4426770d5b9d tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1738 microversion: 2.20 time: 0.280432 Aug 18 12:27:33.371895 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 378/746] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:33 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1738 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:33.739658 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-fc858dda-9a5c-4849-882e-9d6dd8ad15bc tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:33.740659 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-fc858dda-9a5c-4849-882e-9d6dd8ad15bc tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:33.748472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fc858dda-9a5c-4849-882e-9d6dd8ad15bc tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:33.749031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fc858dda-9a5c-4849-882e-9d6dd8ad15bc tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:33.749912 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fc858dda-9a5c-4849-882e-9d6dd8ad15bc tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:33.751541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fc858dda-9a5c-4849-882e-9d6dd8ad15bc tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:33.752213 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fc858dda-9a5c-4849-882e-9d6dd8ad15bc tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:33.752787 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fc858dda-9a5c-4849-882e-9d6dd8ad15bc tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:33.793694 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-fc858dda-9a5c-4849-882e-9d6dd8ad15bc tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Going to try to terminate instance {{(pid=121244) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:27:34.060029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-fc858dda-9a5c-4849-882e-9d6dd8ad15bc tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "DELETE /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 204 len: 0 microversion: 2.1 time: 0.324795 Aug 18 12:27:34.061238 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 369/747] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:27:33 2022] DELETE /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:27:34.070077 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-922ae6bf-17aa-44e0-825b-4254e231aeb2 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:34.071075 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-922ae6bf-17aa-44e0-825b-4254e231aeb2 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:34.078392 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-922ae6bf-17aa-44e0-825b-4254e231aeb2 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:34.079571 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-922ae6bf-17aa-44e0-825b-4254e231aeb2 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:34.079571 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-922ae6bf-17aa-44e0-825b-4254e231aeb2 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:34.080272 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-922ae6bf-17aa-44e0-825b-4254e231aeb2 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:34.080437 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-922ae6bf-17aa-44e0-825b-4254e231aeb2 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:34.080851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-922ae6bf-17aa-44e0-825b-4254e231aeb2 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:34.236338 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-922ae6bf-17aa-44e0-825b-4254e231aeb2 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:34.246392 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-922ae6bf-17aa-44e0-825b-4254e231aeb2 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1504 microversion: 2.1 time: 0.180217 Aug 18 12:27:34.250774 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 379/748] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:34 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:34.384926 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:34.385565 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:34.393992 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:34.395010 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:34.395784 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:34.396836 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:34.397448 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:34.398044 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:34.542247 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:34.551632 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:34.553348 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:34.554728 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-681f0176-b91f-4446-901d-bd910f3bc9f1 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1738 microversion: 2.20 time: 0.174431 Aug 18 12:27:34.567642 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 370/749] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:34 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:35.269930 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-beae1108-7b1d-4f92-bef9-4c5b48a5ecfb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:35.270521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-beae1108-7b1d-4f92-bef9-4c5b48a5ecfb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:35.276926 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beae1108-7b1d-4f92-bef9-4c5b48a5ecfb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:35.277404 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beae1108-7b1d-4f92-bef9-4c5b48a5ecfb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:35.277833 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beae1108-7b1d-4f92-bef9-4c5b48a5ecfb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:35.278519 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beae1108-7b1d-4f92-bef9-4c5b48a5ecfb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:35.278966 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beae1108-7b1d-4f92-bef9-4c5b48a5ecfb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:35.279393 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-beae1108-7b1d-4f92-bef9-4c5b48a5ecfb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:35.452072 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-beae1108-7b1d-4f92-bef9-4c5b48a5ecfb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:35.460420 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-beae1108-7b1d-4f92-bef9-4c5b48a5ecfb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1504 microversion: 2.1 time: 0.194188 Aug 18 12:27:35.461602 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 380/750] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:35 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:35.578102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:35.578780 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:35.589242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:35.589812 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:35.590315 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:35.595129 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:35.596241 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:35.597266 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:35.832084 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:35.839286 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:35.841249 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:35.843290 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-370473a7-ff0b-4281-82ca-080218d7d58e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1738 microversion: 2.20 time: 0.268588 Aug 18 12:27:35.844419 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 371/751] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:35 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:36.216252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-e75dec84-83a4-4ce5-ac7e-ebb2c767ed76 req-e0422be6-93c2-467d-9839-913958281d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e41112-3597-4728-87cc-2ea4746a32d6", "name": "network-vif-deleted", "tag": "17bf7029-c042-4a17-bcf7-fc95eb6aaa65"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:36.243335 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-e75dec84-83a4-4ce5-ac7e-ebb2c767ed76 req-e0422be6-93c2-467d-9839-913958281d43 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:36.243752 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-e75dec84-83a4-4ce5-ac7e-ebb2c767ed76 req-e0422be6-93c2-467d-9839-913958281d43 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:36.244181 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-e75dec84-83a4-4ce5-ac7e-ebb2c767ed76 req-e0422be6-93c2-467d-9839-913958281d43 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:36.261592 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-e75dec84-83a4-4ce5-ac7e-ebb2c767ed76 req-e0422be6-93c2-467d-9839-913958281d43 service nova] Creating event network-vif-deleted:17bf7029-c042-4a17-bcf7-fc95eb6aaa65 for instance 62e41112-3597-4728-87cc-2ea4746a32d6 on hv-cinder-83602 Aug 18 12:27:36.274578 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-e75dec84-83a4-4ce5-ac7e-ebb2c767ed76 req-e0422be6-93c2-467d-9839-913958281d43 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061788 Aug 18 12:27:36.276430 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 381/752] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:27:36.484113 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5dc3e765-0340-4512-8f5b-888bc2033b39 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:36.485289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5dc3e765-0340-4512-8f5b-888bc2033b39 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:36.490888 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dc3e765-0340-4512-8f5b-888bc2033b39 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:36.491468 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dc3e765-0340-4512-8f5b-888bc2033b39 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:36.491974 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dc3e765-0340-4512-8f5b-888bc2033b39 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:36.492835 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dc3e765-0340-4512-8f5b-888bc2033b39 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:36.493408 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dc3e765-0340-4512-8f5b-888bc2033b39 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:36.493865 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5dc3e765-0340-4512-8f5b-888bc2033b39 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:36.566760 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5dc3e765-0340-4512-8f5b-888bc2033b39 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:36.575815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5dc3e765-0340-4512-8f5b-888bc2033b39 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 200 len: 1299 microversion: 2.1 time: 0.097664 Aug 18 12:27:36.576465 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 372/753] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:36 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:36.873008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:36.875695 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:36.882471 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:36.882952 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:36.883384 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:36.884105 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:36.884555 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:36.884981 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:37.032277 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:37.041018 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:37.042604 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:37.043878 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-9218a2ca-cfea-4f68-9ebf-1d4d259ad638 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1738 microversion: 2.20 time: 0.175680 Aug 18 12:27:37.044502 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 382/754] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:36 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:37.598170 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:37.599335 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 62e41112-3597-4728-87cc-2ea4746a32d6] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:37.608170 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:37.611376 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:37.611376 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:37.611376 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:37.611376 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:37.612441 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:37.625992 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] HTTP exception thrown: Instance 62e41112-3597-4728-87cc-2ea4746a32d6 could not be found. Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Request method failure captured: Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 HTTP/1.1 Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jAkKP9kPVPL1gnqw7I4oJUIvPP6yoFHDgC5SSPZz_vnJxEQdbX-huU1eDK9orbvKTc50yi1KBa8tEZ9--2D-8bxRA83CG2MnC3HBtwOzpifgRDQbWsLNZiAYAA2FuN4XJ0iBa-ytaNLwKQvoLTFHVBI-CHqcrFP7ZEqqlduARK_u68 Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 672f308b487a4c0bb2d3e731542289cf Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-VolumesActionsTest-84135846 Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:27:37.627676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/672f308b487a4c0bb2d3e731542289cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/672f308b487a4c0bb2d3e731542289cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/672f308b487a4c0bb2d3e731542289cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_672f308b487a4c0bb2d3e731542289cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-VolumesActionsTest-84135846 Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 672f308b487a4c0bb2d3e731542289cf Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-VolumesActionsTest-84135846 Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-VolumesActionsTest-84135846-project Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: cb91581b839c4318a1bb6c53e63f2649 Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-VolumesActionsTest-84135846-project Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 62e41112-3597-4728-87cc-2ea4746a32d6 could not be found. Aug 18 12:27:37.629403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '62e41112-3597-4728-87cc-2ea4746a32d6'} Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e41112-3597-4728-87cc-2ea4746a32d6 could not be found. Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:27:37.630296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e41112-3597-4728-87cc-2ea4746a32d6 could not be found. Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e41112-3597-4728-87cc-2ea4746a32d6 could not be found. Aug 18 12:27:37.631650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:27:37.632782 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Returning 404 to user: Instance 62e41112-3597-4728-87cc-2ea4746a32d6 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:27:37.632782 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f1b5494f-7d58-41ca-b21b-41530ae6eb79 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6" status: 404 len: 111 microversion: 2.1 time: 0.034795 Aug 18 12:27:37.632782 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 373/755] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:37 2022] GET /compute/v2.1/servers/62e41112-3597-4728-87cc-2ea4746a32d6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:27:37.735286 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-469387982", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "networks": [{"uuid": "fac57b00-9eb9-426b-9f5b-54198cd083f4"}]}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:37.794665 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.network.neutron [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] validate_networks() for [('fac57b00-9eb9-426b-9f5b-54198cd083f4', None, None, None, None, None)] {{(pid=121245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:27:38.070081 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:38.070719 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:38.078062 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:38.078551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:38.078993 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:38.079996 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:38.080477 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:38.080975 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:38.097429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:38.230223 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:38.238985 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:38.240625 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:38.241845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5335b15a-756b-40db-9b1a-35aa792f9038 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1720 microversion: 2.20 time: 0.175775 Aug 18 12:27:38.242423 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 374/756] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:38 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:38.519555 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Flavor limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:27:38.519979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Image limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:27:38.520455 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Flavor pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:27:38.520889 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Image pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:27:38.521330 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:27:38.530083 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:38.533396 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:38.533396 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:38.533396 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:38.533396 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:38.533803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:38.550680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Getting quotas for project 672f308b487a4c0bb2d3e731542289cf. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:27:38.554743 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Getting quotas for user cb91581b839c4318a1bb6c53e63f2649 and project 672f308b487a4c0bb2d3e731542289cf. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:27:38.565777 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Going to run 1 instances... {{(pid=121245) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:27:38.568108 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:27:38.707852 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8194985e-9dff-489c-a131-a79f43399ca1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976754 Aug 18 12:27:38.708496 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 383/757] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:27:38.720320 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b02acfaa-72b9-4e64-b37a-d15bc775ece9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:38.721010 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b02acfaa-72b9-4e64-b37a-d15bc775ece9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:38.779360 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b02acfaa-72b9-4e64-b37a-d15bc775ece9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:38.786008 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b02acfaa-72b9-4e64-b37a-d15bc775ece9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1213 microversion: 2.1 time: 0.070313 Aug 18 12:27:38.786786 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 375/758] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:38 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:39.266527 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:39.267056 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:39.274252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:39.274738 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:39.275366 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:39.276126 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:39.276580 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:39.277009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:39.408453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:39.416591 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:39.418135 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:39.419290 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0f1855ff-b828-42dc-ae17-37fc0a0a8244 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1720 microversion: 2.20 time: 0.157564 Aug 18 12:27:39.419984 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 384/759] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:39 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:39.806404 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-65bc74ce-7ffd-4a9f-82e5-04906dc2b1f4 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:39.807011 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-65bc74ce-7ffd-4a9f-82e5-04906dc2b1f4 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:39.886733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-c9281e48-75ae-4321-a1eb-bbfa5d667c2b req-95103e25-d0cc-410c-861c-57cbcd694e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f0a98d-091a-4d0c-8e84-79fbb60d71a8", "name": "network-vif-unplugged", "status": "completed", "tag": "5ed6bae6-8e44-4797-93ff-eaa620fb9744"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:39.898235 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-c9281e48-75ae-4321-a1eb-bbfa5d667c2b req-95103e25-d0cc-410c-861c-57cbcd694e70 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:39.898853 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-c9281e48-75ae-4321-a1eb-bbfa5d667c2b req-95103e25-d0cc-410c-861c-57cbcd694e70 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:39.902416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-c9281e48-75ae-4321-a1eb-bbfa5d667c2b req-95103e25-d0cc-410c-861c-57cbcd694e70 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:39.914969 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-c9281e48-75ae-4321-a1eb-bbfa5d667c2b req-95103e25-d0cc-410c-861c-57cbcd694e70 service nova] Creating event network-vif-unplugged:5ed6bae6-8e44-4797-93ff-eaa620fb9744 for instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 on hv-cinder-83602 Aug 18 12:27:39.920799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-c9281e48-75ae-4321-a1eb-bbfa5d667c2b req-95103e25-d0cc-410c-861c-57cbcd694e70 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039485 Aug 18 12:27:39.921861 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 385/760] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:27:39.973975 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-65bc74ce-7ffd-4a9f-82e5-04906dc2b1f4 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:39.974536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-65bc74ce-7ffd-4a9f-82e5-04906dc2b1f4 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:39.974979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-65bc74ce-7ffd-4a9f-82e5-04906dc2b1f4 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:39.977103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-65bc74ce-7ffd-4a9f-82e5-04906dc2b1f4 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:39.977103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-65bc74ce-7ffd-4a9f-82e5-04906dc2b1f4 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:39.977103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-65bc74ce-7ffd-4a9f-82e5-04906dc2b1f4 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:40.049891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-65bc74ce-7ffd-4a9f-82e5-04906dc2b1f4 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:40.057870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-65bc74ce-7ffd-4a9f-82e5-04906dc2b1f4 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1209 microversion: 2.1 time: 0.255493 Aug 18 12:27:40.058666 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 376/761] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:39 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1209 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:40.444192 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:40.444875 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:40.450960 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:40.451485 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:40.451911 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:40.452649 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:40.453119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:40.453536 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:40.589035 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:40.597645 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:40.599171 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:40.600378 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ce43efab-e88a-4587-a827-05746008a893 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1663 microversion: 2.20 time: 0.160890 Aug 18 12:27:40.600981 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 386/762] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:40 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:40.623737 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3c3d4270-7346-4d6b-b0c3-0cb497489144 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f79b85a-75a7-4795-b291-5829222defdc"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:40.626778 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3c3d4270-7346-4d6b-b0c3-0cb497489144 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:40.638907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c3d4270-7346-4d6b-b0c3-0cb497489144 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:40.639409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c3d4270-7346-4d6b-b0c3-0cb497489144 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:40.639882 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c3d4270-7346-4d6b-b0c3-0cb497489144 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:40.640595 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c3d4270-7346-4d6b-b0c3-0cb497489144 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:40.641059 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c3d4270-7346-4d6b-b0c3-0cb497489144 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:40.641508 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c3d4270-7346-4d6b-b0c3-0cb497489144 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:41.082202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3d917ead-fb60-4dbc-9920-52d50f245b8e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:41.082202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3d917ead-fb60-4dbc-9920-52d50f245b8e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:41.088838 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3d917ead-fb60-4dbc-9920-52d50f245b8e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:41.089603 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3d917ead-fb60-4dbc-9920-52d50f245b8e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:41.090038 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3d917ead-fb60-4dbc-9920-52d50f245b8e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:41.090724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3d917ead-fb60-4dbc-9920-52d50f245b8e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:41.091168 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3d917ead-fb60-4dbc-9920-52d50f245b8e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:41.091611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3d917ead-fb60-4dbc-9920-52d50f245b8e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:41.161479 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3d917ead-fb60-4dbc-9920-52d50f245b8e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:41.170753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3d917ead-fb60-4dbc-9920-52d50f245b8e tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1283 microversion: 2.1 time: 0.094245 Aug 18 12:27:41.171319 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 387/763] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:41 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:41.767894 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3c3d4270-7346-4d6b-b0c3-0cb497489144 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "POST /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.148269 Aug 18 12:27:41.768526 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 377/764] 10.222.0.98 () {62 vars in 1364 bytes} [Thu Aug 18 12:27:40 2022] POST /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/os-volume_attachments => generated 188 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:27:41.903903 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2450a0a7-4c15-483f-a0c7-851d20b1dd2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:41.904457 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-2450a0a7-4c15-483f-a0c7-851d20b1dd2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:41.911577 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2450a0a7-4c15-483f-a0c7-851d20b1dd2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:41.912178 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2450a0a7-4c15-483f-a0c7-851d20b1dd2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:41.912701 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2450a0a7-4c15-483f-a0c7-851d20b1dd2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:41.913517 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2450a0a7-4c15-483f-a0c7-851d20b1dd2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:41.914242 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2450a0a7-4c15-483f-a0c7-851d20b1dd2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:41.914876 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2450a0a7-4c15-483f-a0c7-851d20b1dd2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:41.919301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=100 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:42.193438 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-767037a0-4c74-48f0-b9f3-2fd5abd6f1eb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:42.194340 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-767037a0-4c74-48f0-b9f3-2fd5abd6f1eb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:42.202091 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-767037a0-4c74-48f0-b9f3-2fd5abd6f1eb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:42.202928 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-767037a0-4c74-48f0-b9f3-2fd5abd6f1eb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:42.203667 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-767037a0-4c74-48f0-b9f3-2fd5abd6f1eb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:42.205734 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-767037a0-4c74-48f0-b9f3-2fd5abd6f1eb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:42.206355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-767037a0-4c74-48f0-b9f3-2fd5abd6f1eb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:42.206958 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-767037a0-4c74-48f0-b9f3-2fd5abd6f1eb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:42.418742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-767037a0-4c74-48f0-b9f3-2fd5abd6f1eb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:42.426994 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-767037a0-4c74-48f0-b9f3-2fd5abd6f1eb tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.239247 Aug 18 12:27:42.427606 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 378/765] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:42 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:42.514629 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-12bfeeb7-68ac-4a1e-8132-91a207711cce req-f58b8756-9d81-41ae-b3ff-4e60d683ff2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7926aff5-edf4-4afb-acd2-59583e3180d4", "tag": "494aa5d5-19ca-4493-84ba-614f3062c760"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:42.524930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-12bfeeb7-68ac-4a1e-8132-91a207711cce req-f58b8756-9d81-41ae-b3ff-4e60d683ff2a service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:42.525529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-12bfeeb7-68ac-4a1e-8132-91a207711cce req-f58b8756-9d81-41ae-b3ff-4e60d683ff2a service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:42.525958 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-12bfeeb7-68ac-4a1e-8132-91a207711cce req-f58b8756-9d81-41ae-b3ff-4e60d683ff2a service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:42.536885 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-12bfeeb7-68ac-4a1e-8132-91a207711cce req-f58b8756-9d81-41ae-b3ff-4e60d683ff2a service nova] Creating event network-changed:494aa5d5-19ca-4493-84ba-614f3062c760 for instance 7926aff5-edf4-4afb-acd2-59583e3180d4 on hv-cinder-83602 Aug 18 12:27:42.542123 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-12bfeeb7-68ac-4a1e-8132-91a207711cce req-f58b8756-9d81-41ae-b3ff-4e60d683ff2a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031851 Aug 18 12:27:42.543166 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 379/766] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:27:42.582598 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2450a0a7-4c15-483f-a0c7-851d20b1dd2c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "DELETE /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/os-volume_attachments/0f79b85a-75a7-4795-b291-5829222defdc" status: 202 len: 0 microversion: 2.20 time: 0.682260 Aug 18 12:27:42.587113 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 388/767] 10.222.0.98 () {60 vars in 1457 bytes} [Thu Aug 18 12:27:41 2022] DELETE /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/os-volume_attachments/0f79b85a-75a7-4795-b291-5829222defdc => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:27:42.647117 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-91ce1ff7-74ff-4c1f-9101-e62242101189 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:42.647966 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-91ce1ff7-74ff-4c1f-9101-e62242101189 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:42.655970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91ce1ff7-74ff-4c1f-9101-e62242101189 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:42.655970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91ce1ff7-74ff-4c1f-9101-e62242101189 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:42.655970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91ce1ff7-74ff-4c1f-9101-e62242101189 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:42.656273 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91ce1ff7-74ff-4c1f-9101-e62242101189 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:42.656606 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91ce1ff7-74ff-4c1f-9101-e62242101189 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:42.657062 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-91ce1ff7-74ff-4c1f-9101-e62242101189 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:42.691287 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-91ce1ff7-74ff-4c1f-9101-e62242101189 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121244) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 18 12:27:43.059023 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-91ce1ff7-74ff-4c1f-9101-e62242101189 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "POST /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/action" status: 202 len: 0 microversion: 2.20 time: 0.416201 Aug 18 12:27:43.060750 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 380/768] 10.222.0.98 () {62 vars in 1319 bytes} [Thu Aug 18 12:27:42 2022] POST /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:27:43.068726 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:43.069473 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:43.076685 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.077280 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.077816 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.078615 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.079311 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.079986 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.221140 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:43.232279 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:43.234033 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:43.235990 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-717298ce-e15e-4733-a668-26c5966888c7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1671 microversion: 2.20 time: 0.170728 Aug 18 12:27:43.237435 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 389/769] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:43 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:27:43.451327 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-7b909722-f383-421e-a74b-6bc7bb9c0f29 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:43.452020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-7b909722-f383-421e-a74b-6bc7bb9c0f29 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:43.458684 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b909722-f383-421e-a74b-6bc7bb9c0f29 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.459181 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b909722-f383-421e-a74b-6bc7bb9c0f29 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.459637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b909722-f383-421e-a74b-6bc7bb9c0f29 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.460341 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b909722-f383-421e-a74b-6bc7bb9c0f29 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.460798 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b909722-f383-421e-a74b-6bc7bb9c0f29 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.461226 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7b909722-f383-421e-a74b-6bc7bb9c0f29 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.592673 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-7b909722-f383-421e-a74b-6bc7bb9c0f29 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:43.601197 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-7b909722-f383-421e-a74b-6bc7bb9c0f29 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.154329 Aug 18 12:27:43.601764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 381/770] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:43 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:44.259581 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:44.260283 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:44.267128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:44.267892 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:44.269842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:44.269842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:44.269842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:44.270250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:44.409513 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:44.418098 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:44.419537 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:44.424217 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ab94e18a-1cf5-4e45-af07-8f54604d28b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1671 microversion: 2.20 time: 0.165334 Aug 18 12:27:44.424217 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 390/771] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:44 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:44.621531 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-80423fe1-21c9-41b2-a403-4d4b1b7e873f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:44.622398 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-80423fe1-21c9-41b2-a403-4d4b1b7e873f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:44.631174 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-80423fe1-21c9-41b2-a403-4d4b1b7e873f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:44.631702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-80423fe1-21c9-41b2-a403-4d4b1b7e873f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:44.632293 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-80423fe1-21c9-41b2-a403-4d4b1b7e873f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:44.633014 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-80423fe1-21c9-41b2-a403-4d4b1b7e873f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:44.633467 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-80423fe1-21c9-41b2-a403-4d4b1b7e873f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:44.634077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-80423fe1-21c9-41b2-a403-4d4b1b7e873f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:44.765641 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-80423fe1-21c9-41b2-a403-4d4b1b7e873f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:44.773854 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-80423fe1-21c9-41b2-a403-4d4b1b7e873f tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.156327 Aug 18 12:27:44.779164 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 382/772] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:44 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:45.444175 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:45.445006 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:45.451871 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:45.452501 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:45.453045 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:45.453863 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:45.454444 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:45.455604 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:45.625869 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:45.636798 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:45.639512 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:45.641110 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1d72a843-4999-40ee-8ac4-e79dc73f11f7 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.201767 Aug 18 12:27:45.641973 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 391/773] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:45 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:45.795855 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0a64331a-c1ae-4699-b154-76001c10f3f3 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:45.797197 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0a64331a-c1ae-4699-b154-76001c10f3f3 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:45.805039 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0a64331a-c1ae-4699-b154-76001c10f3f3 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:45.805893 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0a64331a-c1ae-4699-b154-76001c10f3f3 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:45.806530 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0a64331a-c1ae-4699-b154-76001c10f3f3 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:45.807243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0a64331a-c1ae-4699-b154-76001c10f3f3 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:45.807949 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0a64331a-c1ae-4699-b154-76001c10f3f3 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:45.808552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0a64331a-c1ae-4699-b154-76001c10f3f3 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:46.129346 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0a64331a-c1ae-4699-b154-76001c10f3f3 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:46.137326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0a64331a-c1ae-4699-b154-76001c10f3f3 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.346723 Aug 18 12:27:46.137938 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 383/774] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:45 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:46.665678 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:46.667612 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:46.674733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:46.675627 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:46.676286 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:46.677410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:46.678100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:46.678585 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:46.850138 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:46.859529 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:46.861394 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:46.862513 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e5cf269b-5f93-4f22-8448-659b25679198 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.201061 Aug 18 12:27:46.863567 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 392/775] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:46 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:47.159611 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-23ee69b9-8ce1-41ec-b8e3-dc2829ecff3b tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:47.160233 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-23ee69b9-8ce1-41ec-b8e3-dc2829ecff3b tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:47.172868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23ee69b9-8ce1-41ec-b8e3-dc2829ecff3b tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:47.176004 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23ee69b9-8ce1-41ec-b8e3-dc2829ecff3b tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:47.176689 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23ee69b9-8ce1-41ec-b8e3-dc2829ecff3b tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:47.177673 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23ee69b9-8ce1-41ec-b8e3-dc2829ecff3b tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:47.180037 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23ee69b9-8ce1-41ec-b8e3-dc2829ecff3b tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:47.184839 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-23ee69b9-8ce1-41ec-b8e3-dc2829ecff3b tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:47.485075 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-23ee69b9-8ce1-41ec-b8e3-dc2829ecff3b tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:47.495559 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-23ee69b9-8ce1-41ec-b8e3-dc2829ecff3b tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.340945 Aug 18 12:27:47.509512 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 384/776] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:47 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:47.886655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:47.887952 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:47.899840 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:47.908542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:47.911544 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:47.912423 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:47.916153 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:47.916956 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:48.194416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:48.206580 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:48.211267 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:48.214654 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7f4d7ded-0653-4e66-86b1-5371b4111188 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.332258 Aug 18 12:27:48.220232 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 393/777] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:47 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:48.279560 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-387ae20b-c85f-4191-91b7-725416d8e43a req-1b368117-c29f-4a8d-a948-439b07fe143e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7926aff5-edf4-4afb-acd2-59583e3180d4", "name": "network-vif-plugged", "status": "completed", "tag": "494aa5d5-19ca-4493-84ba-614f3062c760"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:48.295705 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-387ae20b-c85f-4191-91b7-725416d8e43a req-1b368117-c29f-4a8d-a948-439b07fe143e service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:48.302573 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-387ae20b-c85f-4191-91b7-725416d8e43a req-1b368117-c29f-4a8d-a948-439b07fe143e service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:48.302573 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-387ae20b-c85f-4191-91b7-725416d8e43a req-1b368117-c29f-4a8d-a948-439b07fe143e service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:48.349296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-387ae20b-c85f-4191-91b7-725416d8e43a req-1b368117-c29f-4a8d-a948-439b07fe143e service nova] Creating event network-vif-plugged:494aa5d5-19ca-4493-84ba-614f3062c760 for instance 7926aff5-edf4-4afb-acd2-59583e3180d4 on hv-cinder-83602 Aug 18 12:27:48.362872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-387ae20b-c85f-4191-91b7-725416d8e43a req-1b368117-c29f-4a8d-a948-439b07fe143e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086217 Aug 18 12:27:48.367243 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 385/778] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:27:48.516619 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f792e480-27a5-466c-88f8-b10ddd1d5775 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:48.517760 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f792e480-27a5-466c-88f8-b10ddd1d5775 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:48.524760 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f792e480-27a5-466c-88f8-b10ddd1d5775 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:48.525520 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f792e480-27a5-466c-88f8-b10ddd1d5775 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:48.526139 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f792e480-27a5-466c-88f8-b10ddd1d5775 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:48.527031 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f792e480-27a5-466c-88f8-b10ddd1d5775 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:48.527515 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f792e480-27a5-466c-88f8-b10ddd1d5775 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:48.529208 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f792e480-27a5-466c-88f8-b10ddd1d5775 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:48.551852 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:48.568829 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=6 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:48.764107 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f792e480-27a5-466c-88f8-b10ddd1d5775 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:48.775783 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f792e480-27a5-466c-88f8-b10ddd1d5775 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.262847 Aug 18 12:27:48.777019 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 394/779] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:48 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:49.243335 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:49.244219 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:49.246380 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:49.255468 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:49.255994 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:49.258841 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:49.258841 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:49.258841 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:49.258841 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:49.560305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:49.584401 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:49.587339 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:49.593614 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b83e15f0-b2e2-4239-a9b2-568167923c6c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.352109 Aug 18 12:27:49.596230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 386/780] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:49 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:49.809439 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4dcd4eec-e6a4-41df-86c7-f91022917b3d tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:49.810079 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-4dcd4eec-e6a4-41df-86c7-f91022917b3d tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:49.820025 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dcd4eec-e6a4-41df-86c7-f91022917b3d tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:49.820751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dcd4eec-e6a4-41df-86c7-f91022917b3d tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:49.821476 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dcd4eec-e6a4-41df-86c7-f91022917b3d tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:49.822428 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dcd4eec-e6a4-41df-86c7-f91022917b3d tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:49.823155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dcd4eec-e6a4-41df-86c7-f91022917b3d tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:49.823872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4dcd4eec-e6a4-41df-86c7-f91022917b3d tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:50.190556 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-4dcd4eec-e6a4-41df-86c7-f91022917b3d tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:50.204215 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4dcd4eec-e6a4-41df-86c7-f91022917b3d tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.406580 Aug 18 12:27:50.219378 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 395/781] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:49 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:50.621453 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:50.622155 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:50.632614 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:50.633118 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:50.633559 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:50.636933 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:50.639707 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:50.640160 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:51.000347 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:51.041096 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:51.058999 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:51.069086 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d50134bb-e2ab-4f55-a628-2ec37af19108 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.451776 Aug 18 12:27:51.071180 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 387/782] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:50 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:51.233195 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-dacfbbc1-9903-4a9e-932f-9abb7af82791 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:51.233823 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-dacfbbc1-9903-4a9e-932f-9abb7af82791 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:51.246783 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dacfbbc1-9903-4a9e-932f-9abb7af82791 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:51.247525 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dacfbbc1-9903-4a9e-932f-9abb7af82791 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:51.248159 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dacfbbc1-9903-4a9e-932f-9abb7af82791 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:51.249195 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dacfbbc1-9903-4a9e-932f-9abb7af82791 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:51.249820 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dacfbbc1-9903-4a9e-932f-9abb7af82791 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:51.263725 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dacfbbc1-9903-4a9e-932f-9abb7af82791 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:51.482093 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-dacfbbc1-9903-4a9e-932f-9abb7af82791 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:51.495644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-dacfbbc1-9903-4a9e-932f-9abb7af82791 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.261588 Aug 18 12:27:51.495644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 396/783] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:51 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:52.095696 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:52.096946 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:52.106488 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:52.107132 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:52.108088 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:52.118821 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:52.120999 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:52.122008 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:52.515003 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e252d78d-4e0f-4d88-b4b8-426a9e088735 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:52.521144 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e252d78d-4e0f-4d88-b4b8-426a9e088735 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:52.531710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e252d78d-4e0f-4d88-b4b8-426a9e088735 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:52.532488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e252d78d-4e0f-4d88-b4b8-426a9e088735 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:52.532955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e252d78d-4e0f-4d88-b4b8-426a9e088735 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:52.533772 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e252d78d-4e0f-4d88-b4b8-426a9e088735 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:52.534301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e252d78d-4e0f-4d88-b4b8-426a9e088735 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:52.534913 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e252d78d-4e0f-4d88-b4b8-426a9e088735 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:52.664007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:52.675337 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:52.677714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:52.679171 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-183619a0-21bb-4310-940b-48bd3d86fbd2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.587495 Aug 18 12:27:52.680295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 388/784] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:52 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:27:52.834155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e252d78d-4e0f-4d88-b4b8-426a9e088735 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:52.849242 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e252d78d-4e0f-4d88-b4b8-426a9e088735 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.338985 Aug 18 12:27:52.867212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 397/785] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:52 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:53.703863 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:53.704538 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:53.719516 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:53.722608 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:53.723390 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:53.724512 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:53.725326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:53.726102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:53.875809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-27f5df81-ae4a-4bac-8274-f709c6ff7b4c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:53.876457 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-27f5df81-ae4a-4bac-8274-f709c6ff7b4c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:53.889642 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27f5df81-ae4a-4bac-8274-f709c6ff7b4c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:53.895228 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27f5df81-ae4a-4bac-8274-f709c6ff7b4c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:53.895228 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27f5df81-ae4a-4bac-8274-f709c6ff7b4c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:53.895228 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27f5df81-ae4a-4bac-8274-f709c6ff7b4c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:53.895228 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27f5df81-ae4a-4bac-8274-f709c6ff7b4c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:53.896148 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-27f5df81-ae4a-4bac-8274-f709c6ff7b4c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:53.909042 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:53.911249 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:53.921654 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:53.933588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:53.935185 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-64483e67-bc94-46d8-a319-c2c7040cc118 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.235799 Aug 18 12:27:53.948447 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 389/786] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:53 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:54.076915 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-27f5df81-ae4a-4bac-8274-f709c6ff7b4c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:54.086372 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-27f5df81-ae4a-4bac-8274-f709c6ff7b4c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.214639 Aug 18 12:27:54.086962 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 398/787] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:53 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:54.960444 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:54.970475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:54.970475 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:54.971296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:54.971940 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:54.979149 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:54.979789 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:54.980234 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:55.109231 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-63faab76-fb84-4f26-8f40-c55c177eb281 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:55.111307 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-63faab76-fb84-4f26-8f40-c55c177eb281 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:55.126524 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-63faab76-fb84-4f26-8f40-c55c177eb281 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:55.127012 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-63faab76-fb84-4f26-8f40-c55c177eb281 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:55.130569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-63faab76-fb84-4f26-8f40-c55c177eb281 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:55.135061 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-63faab76-fb84-4f26-8f40-c55c177eb281 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:55.135061 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-63faab76-fb84-4f26-8f40-c55c177eb281 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:55.135061 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-63faab76-fb84-4f26-8f40-c55c177eb281 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:55.382518 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-63faab76-fb84-4f26-8f40-c55c177eb281 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:55.393010 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-63faab76-fb84-4f26-8f40-c55c177eb281 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.288208 Aug 18 12:27:55.397673 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 399/788] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:55 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:55.578688 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:55.589744 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:55.598382 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:55.600984 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6af9f8a5-3398-4b3d-a886-116d6164ec40 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.644753 Aug 18 12:27:55.605133 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 390/789] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:54 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:56.421435 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b669c928-0889-4a69-9a1a-d0a300bf28b9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:56.422121 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b669c928-0889-4a69-9a1a-d0a300bf28b9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:56.431743 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b669c928-0889-4a69-9a1a-d0a300bf28b9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:56.432228 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b669c928-0889-4a69-9a1a-d0a300bf28b9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:56.432660 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b669c928-0889-4a69-9a1a-d0a300bf28b9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:56.433372 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b669c928-0889-4a69-9a1a-d0a300bf28b9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:56.433815 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b669c928-0889-4a69-9a1a-d0a300bf28b9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:56.434235 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b669c928-0889-4a69-9a1a-d0a300bf28b9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:56.630304 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b669c928-0889-4a69-9a1a-d0a300bf28b9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:56.644732 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:56.645768 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:56.646361 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b669c928-0889-4a69-9a1a-d0a300bf28b9 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.229257 Aug 18 12:27:56.647908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 400/790] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:56 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:56.675017 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:56.677363 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:56.678665 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:56.679610 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:56.681807 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:56.683076 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:56.998774 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:57.007725 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:57.009530 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:57.011730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e0a8fa8e-03ad-47a1-86dc-ef53e9cd5a88 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.386210 Aug 18 12:27:57.024605 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 391/791] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:56 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:57.670148 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-610a366a-ab7f-4fe3-9ac2-066af9734c22 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:57.671504 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-610a366a-ab7f-4fe3-9ac2-066af9734c22 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:57.679506 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-610a366a-ab7f-4fe3-9ac2-066af9734c22 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:57.680273 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-610a366a-ab7f-4fe3-9ac2-066af9734c22 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:57.680706 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-610a366a-ab7f-4fe3-9ac2-066af9734c22 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:57.681558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-610a366a-ab7f-4fe3-9ac2-066af9734c22 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:57.682013 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-610a366a-ab7f-4fe3-9ac2-066af9734c22 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:57.682467 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-610a366a-ab7f-4fe3-9ac2-066af9734c22 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:57.836303 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-610a366a-ab7f-4fe3-9ac2-066af9734c22 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:57.845378 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-610a366a-ab7f-4fe3-9ac2-066af9734c22 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1313 microversion: 2.1 time: 0.178938 Aug 18 12:27:57.846377 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 401/792] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:57 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:58.037537 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:58.038157 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:58.044728 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:58.045247 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:58.045687 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:58.046395 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:58.046845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:58.047275 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:58.255088 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:58.265030 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:58.266784 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:58.268356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-435e8b94-a85a-48cc-bb45-535fc08ff83a tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.236333 Aug 18 12:27:58.269279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 392/793] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:58 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:27:58.866261 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cf9faf38-9408-4f23-bffb-6e0091a9f394 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:58.867052 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-cf9faf38-9408-4f23-bffb-6e0091a9f394 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:58.874135 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf9faf38-9408-4f23-bffb-6e0091a9f394 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:58.874624 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf9faf38-9408-4f23-bffb-6e0091a9f394 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:58.875061 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf9faf38-9408-4f23-bffb-6e0091a9f394 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:58.876360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf9faf38-9408-4f23-bffb-6e0091a9f394 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:58.876851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf9faf38-9408-4f23-bffb-6e0091a9f394 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:58.877461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf9faf38-9408-4f23-bffb-6e0091a9f394 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:58.884549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:59.079898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cf9faf38-9408-4f23-bffb-6e0091a9f394 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:59.097054 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cf9faf38-9408-4f23-bffb-6e0091a9f394 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1498 microversion: 2.1 time: 0.234587 Aug 18 12:27:59.098723 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 402/794] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:58 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1498 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:59.294058 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:59.295289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:59.305295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:59.305790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:59.306295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:59.307139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:59.307648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:59.308261 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:59.548190 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:59.564743 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:59.569661 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:59.571336 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-af65a41e-e304-47e6-9fb3-efebc53814aa tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.283157 Aug 18 12:27:59.587139 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 393/795] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:27:59 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:28:00.111028 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7f00d3e6-13ab-4b80-be5f-898e52f4f3b5 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:00.111744 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7f00d3e6-13ab-4b80-be5f-898e52f4f3b5 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:00.119239 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f00d3e6-13ab-4b80-be5f-898e52f4f3b5 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:00.120077 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f00d3e6-13ab-4b80-be5f-898e52f4f3b5 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:00.120761 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f00d3e6-13ab-4b80-be5f-898e52f4f3b5 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:00.121577 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f00d3e6-13ab-4b80-be5f-898e52f4f3b5 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:00.122131 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f00d3e6-13ab-4b80-be5f-898e52f4f3b5 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:00.122772 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7f00d3e6-13ab-4b80-be5f-898e52f4f3b5 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:00.150347 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7f00d3e6-13ab-4b80-be5f-898e52f4f3b5 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:28:00.311230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b3bb2acc-05d3-4b18-b05a-8861244f751f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Action: 'create', calling method: .version_select at 0x7f3787dfff70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1244825414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsfgAKSza5rQNrcas7akxg0FBSP0lMhOix5e6c3fQy+zH4vwWxpWwyYuS60WmyKAiwafa8Yrh5S7/6PMDflU+o348qroyoTNCGihJt8/rmmU+RPvktod35ojwBqwb6/FA=="}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:00.326052 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-b3bb2acc-05d3-4b18-b05a-8861244f751f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Getting quotas for project e453baf77e6744eb8f001a1c1bb9d0d1. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:28:00.330398 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-b3bb2acc-05d3-4b18-b05a-8861244f751f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Getting quotas for user e664528e3e33426aae2d47640b57e079 and project e453baf77e6744eb8f001a1c1bb9d0d1. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:28:00.332661 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:00.417056 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b3bb2acc-05d3-4b18-b05a-8861244f751f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.289470 Aug 18 12:28:00.417667 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 394/796] 10.222.0.98 () {60 vars in 1159 bytes} [Thu Aug 18 12:28:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:28:00.461604 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7f00d3e6-13ab-4b80-be5f-898e52f4f3b5 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "DELETE /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 204 len: 0 microversion: 2.1 time: 0.361295 Aug 18 12:28:00.462211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 403/797] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:28:00 2022] DELETE /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:28:00.471080 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-caff7c92-4a45-4430-9b1e-ede202e3de6c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:00.475647 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-caff7c92-4a45-4430-9b1e-ede202e3de6c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:00.479124 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-caff7c92-4a45-4430-9b1e-ede202e3de6c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:00.479643 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-caff7c92-4a45-4430-9b1e-ede202e3de6c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:00.480078 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-caff7c92-4a45-4430-9b1e-ede202e3de6c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:00.480767 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-caff7c92-4a45-4430-9b1e-ede202e3de6c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:00.481220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-caff7c92-4a45-4430-9b1e-ede202e3de6c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:00.481638 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-caff7c92-4a45-4430-9b1e-ede202e3de6c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:00.595889 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:00.597851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:00.603223 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:00.603742 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:00.604274 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:00.605015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:00.605465 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:00.605915 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:00.678284 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-caff7c92-4a45-4430-9b1e-ede202e3de6c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:00.686513 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-caff7c92-4a45-4430-9b1e-ede202e3de6c tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1504 microversion: 2.1 time: 0.219691 Aug 18 12:28:00.687160 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 395/798] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:00 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:00.746875 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:00.755648 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:00.757812 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:00.759007 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-dfb64037-ea11-4c03-8e57-691da97bf161 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.167670 Aug 18 12:28:00.759604 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 404/799] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:00 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 12:28:01.708684 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a08be824-1e71-459e-898c-a653fae53de8 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:01.709290 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a08be824-1e71-459e-898c-a653fae53de8 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:01.726569 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a08be824-1e71-459e-898c-a653fae53de8 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:01.727081 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a08be824-1e71-459e-898c-a653fae53de8 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:01.727991 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a08be824-1e71-459e-898c-a653fae53de8 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:01.728725 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a08be824-1e71-459e-898c-a653fae53de8 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:01.729186 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a08be824-1e71-459e-898c-a653fae53de8 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:01.729616 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a08be824-1e71-459e-898c-a653fae53de8 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:01.786167 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:01.786871 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:01.795349 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:01.796657 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:01.797092 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:01.798588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:01.799862 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:01.800322 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:01.951645 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a08be824-1e71-459e-898c-a653fae53de8 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:01.962384 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a08be824-1e71-459e-898c-a653fae53de8 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1504 microversion: 2.1 time: 0.257519 Aug 18 12:28:01.963163 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 396/800] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:01 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:01.970103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:01.984474 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:01.987050 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:01.988661 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d7808482-db18-43b1-80a0-a2f7878ea171 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.208520 Aug 18 12:28:01.989552 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 405/801] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:01 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:28:02.302809 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-8a7ab901-ebc2-4139-ae0e-f666a3b99179 req-56893614-5080-4d2e-8485-9b4b20be0a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f0a98d-091a-4d0c-8e84-79fbb60d71a8", "name": "network-vif-plugged", "status": "completed", "tag": "5ed6bae6-8e44-4797-93ff-eaa620fb9744"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:02.312291 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-8a7ab901-ebc2-4139-ae0e-f666a3b99179 req-56893614-5080-4d2e-8485-9b4b20be0a7c service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:02.312842 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-8a7ab901-ebc2-4139-ae0e-f666a3b99179 req-56893614-5080-4d2e-8485-9b4b20be0a7c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:02.313274 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-8a7ab901-ebc2-4139-ae0e-f666a3b99179 req-56893614-5080-4d2e-8485-9b4b20be0a7c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:02.324473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-8a7ab901-ebc2-4139-ae0e-f666a3b99179 req-56893614-5080-4d2e-8485-9b4b20be0a7c service nova] Creating event network-vif-plugged:5ed6bae6-8e44-4797-93ff-eaa620fb9744 for instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 on hv-cinder-83602 Aug 18 12:28:02.330520 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-8a7ab901-ebc2-4139-ae0e-f666a3b99179 req-56893614-5080-4d2e-8485-9b4b20be0a7c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031375 Aug 18 12:28:02.331143 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 397/802] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:28:02.738512 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-10818853-5df7-4a65-989b-00e851b4bedb req-a3a7deaf-8ee3-4c21-af60-e68d9c2d2985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7926aff5-edf4-4afb-acd2-59583e3180d4", "name": "network-vif-deleted", "tag": "494aa5d5-19ca-4493-84ba-614f3062c760"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:02.748322 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-10818853-5df7-4a65-989b-00e851b4bedb req-a3a7deaf-8ee3-4c21-af60-e68d9c2d2985 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:02.748833 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-10818853-5df7-4a65-989b-00e851b4bedb req-a3a7deaf-8ee3-4c21-af60-e68d9c2d2985 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:02.749290 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-10818853-5df7-4a65-989b-00e851b4bedb req-a3a7deaf-8ee3-4c21-af60-e68d9c2d2985 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:02.761454 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-10818853-5df7-4a65-989b-00e851b4bedb req-a3a7deaf-8ee3-4c21-af60-e68d9c2d2985 service nova] Creating event network-vif-deleted:494aa5d5-19ca-4493-84ba-614f3062c760 for instance 7926aff5-edf4-4afb-acd2-59583e3180d4 on hv-cinder-83602 Aug 18 12:28:02.767291 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-10818853-5df7-4a65-989b-00e851b4bedb req-a3a7deaf-8ee3-4c21-af60-e68d9c2d2985 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032231 Aug 18 12:28:02.768153 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 406/803] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:28:02.986988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c8225e1a-d506-4a5f-8505-39e21ceb5ed0 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:02.986988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c8225e1a-d506-4a5f-8505-39e21ceb5ed0 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:02.993409 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8225e1a-d506-4a5f-8505-39e21ceb5ed0 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:02.994187 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8225e1a-d506-4a5f-8505-39e21ceb5ed0 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:02.994835 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8225e1a-d506-4a5f-8505-39e21ceb5ed0 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:02.995572 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8225e1a-d506-4a5f-8505-39e21ceb5ed0 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:02.996055 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8225e1a-d506-4a5f-8505-39e21ceb5ed0 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:02.996480 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c8225e1a-d506-4a5f-8505-39e21ceb5ed0 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:03.020891 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:03.021730 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:03.028748 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:03.029529 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:03.029849 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:03.030558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:03.031162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:03.031668 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:03.078873 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c8225e1a-d506-4a5f-8505-39e21ceb5ed0 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb91581b839c4318a1bb6c53e63f2649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672f308b487a4c0bb2d3e731542289cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:03.087659 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c8225e1a-d506-4a5f-8505-39e21ceb5ed0 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 200 len: 1298 microversion: 2.1 time: 0.106726 Aug 18 12:28:03.088326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 398/804] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:02 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:03.177990 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:03.187511 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:03.190344 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:03.191728 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cf23fc6a-7d6e-4bba-a0bb-fe649f6b5afb tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.183573 Aug 18 12:28:03.194699 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 407/805] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:03 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:28:04.108283 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:04.108899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] [instance: 7926aff5-edf4-4afb-acd2-59583e3180d4] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:04.116379 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:04.116868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:04.117362 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:04.118078 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:04.118700 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:04.119123 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:04.133522 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] HTTP exception thrown: Instance 7926aff5-edf4-4afb-acd2-59583e3180d4 could not be found. Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Request method failure captured: Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 HTTP/1.1 Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jAkKP9kPVPL1gnqw7I4oJUIvPP6yoFHDgC5SSPZz_vnJxEQdbX-huU1eDK9orbvKTc50yi1KBa8tEZ9--2D-8bxRA83CG2MnC3HBtwOzpifgRDQbWsLNZiAYAA2FuN4XJ0iBa-ytaNLwKQvoLTFHVBI-CHqcrFP7ZEqqlduARK_u68 Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 672f308b487a4c0bb2d3e731542289cf Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-VolumesActionsTest-84135846 Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:28:04.135868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/672f308b487a4c0bb2d3e731542289cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/672f308b487a4c0bb2d3e731542289cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/672f308b487a4c0bb2d3e731542289cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_672f308b487a4c0bb2d3e731542289cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-VolumesActionsTest-84135846 Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 672f308b487a4c0bb2d3e731542289cf Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-VolumesActionsTest-84135846 Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-VolumesActionsTest-84135846-project Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: cb91581b839c4318a1bb6c53e63f2649 Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-VolumesActionsTest-84135846-project Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 7926aff5-edf4-4afb-acd2-59583e3180d4 could not be found. Aug 18 12:28:04.137505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '7926aff5-edf4-4afb-acd2-59583e3180d4'} Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7926aff5-edf4-4afb-acd2-59583e3180d4 could not be found. Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:28:04.138702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7926aff5-edf4-4afb-acd2-59583e3180d4 could not be found. Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7926aff5-edf4-4afb-acd2-59583e3180d4 could not be found. Aug 18 12:28:04.140455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:04.142683 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] Returning 404 to user: Instance 7926aff5-edf4-4afb-acd2-59583e3180d4 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:28:04.143734 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-7e184beb-d751-49bc-bf35-7047ef21eed1 tempest-VolumesActionsTest-84135846 tempest-VolumesActionsTest-84135846-project] 10.222.0.98 "GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4" status: 404 len: 111 microversion: 2.1 time: 0.039572 Aug 18 12:28:04.144853 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 399/806] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:04 2022] GET /compute/v2.1/servers/7926aff5-edf4-4afb-acd2-59583e3180d4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:28:04.216750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:04.217468 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:04.220584 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:04.225499 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:04.225986 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:04.226413 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:04.227103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:04.227962 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:04.228817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:04.429120 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:04.437678 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:04.439363 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:04.440553 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c88c843b-812a-47cd-bf79-4c0343c4b71e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.228585 Aug 18 12:28:04.441428 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 408/807] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:04 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:28:05.464058 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:05.464668 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:05.477353 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:05.478111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:05.478541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:05.479312 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:05.480069 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:05.480648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:05.622306 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:05.634628 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:05.636175 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:05.637390 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-af4c38d0-9ee9-435a-9993-7697e7de5eae tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1729 microversion: 2.20 time: 0.177433 Aug 18 12:28:05.639082 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 400/808] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:05 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:28:06.663804 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:06.664347 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:06.671187 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:06.671709 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:06.672133 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:06.672835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:06.673332 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:06.673761 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:06.803584 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:06.811636 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:06.813150 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:06.814337 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-299f2739-3ebf-4d90-902e-90dcd91d2043 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1716 microversion: 2.20 time: 0.155035 Aug 18 12:28:06.814892 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 409/809] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:06 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:28:27.708964 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-865994525", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1244825414", "security_groups": [{"name": "tempest-secgroup-smoke-822990378"}], "networks": [{"uuid": "a2f04548-10b0-40e4-8317-de24caaffc50"}], "block_device_mapping_v2": [{"uuid": "40cf7e11-ac03-4f04-afc4-68b30701bcbd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:27.723447 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=4 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:27.724225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:27.724869 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=53 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:27.887508 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] validate_networks() for [('a2f04548-10b0-40e4-8317-de24caaffc50', None, None, None, None, None)] {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:28:28.304731 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:28:28.305366 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:28:28.305902 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:28:28.306375 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:28:28.306848 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:28:28.316566 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:28.317132 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:28.317650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:28.318551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:28.319144 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:28.319808 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:28.339996 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Getting quotas for project e453baf77e6744eb8f001a1c1bb9d0d1. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:28:28.345897 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Getting quotas for user e664528e3e33426aae2d47640b57e079 and project e453baf77e6744eb8f001a1c1bb9d0d1. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:28:28.418048 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:28:28.419485 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40cf7e11-ac03-4f04-afc4-68b30701bcbd',volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:28:29.068689 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c2b5abc3-ef16-403f-a463-0cf9c1e9534e tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.363882 Aug 18 12:28:29.075539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 401/810] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:28:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:28:29.077856 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=3 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:29.080849 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:29.086218 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c8c0048c-f296-405e-ae05-6f83eec6056f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:29.086976 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c8c0048c-f296-405e-ae05-6f83eec6056f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:29.177368 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c8c0048c-f296-405e-ae05-6f83eec6056f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:29.185216 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c8c0048c-f296-405e-ae05-6f83eec6056f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1088 microversion: 2.1 time: 0.108299 Aug 18 12:28:29.188027 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 410/811] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:29 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1088 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:30.209005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c50cd244-0fa2-446d-b1e5-918f35018a07 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:30.209611 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c50cd244-0fa2-446d-b1e5-918f35018a07 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:30.262895 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c50cd244-0fa2-446d-b1e5-918f35018a07 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:30.269813 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c50cd244-0fa2-446d-b1e5-918f35018a07 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1088 microversion: 2.1 time: 0.065214 Aug 18 12:28:30.270398 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 402/812] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:30 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:31.292248 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e6a840c8-a4be-45af-a447-109c6808a2aa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:31.292862 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e6a840c8-a4be-45af-a447-109c6808a2aa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:31.300341 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e6a840c8-a4be-45af-a447-109c6808a2aa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:31.300932 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e6a840c8-a4be-45af-a447-109c6808a2aa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:31.301448 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e6a840c8-a4be-45af-a447-109c6808a2aa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:31.302153 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e6a840c8-a4be-45af-a447-109c6808a2aa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:31.302603 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e6a840c8-a4be-45af-a447-109c6808a2aa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:31.303066 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e6a840c8-a4be-45af-a447-109c6808a2aa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:31.364516 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e6a840c8-a4be-45af-a447-109c6808a2aa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:31.372327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e6a840c8-a4be-45af-a447-109c6808a2aa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1186 microversion: 2.1 time: 0.084414 Aug 18 12:28:31.372901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 411/813] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:31 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:32.394190 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-96555621-9447-44b2-905d-f304548df074 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:32.395407 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-96555621-9447-44b2-905d-f304548df074 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:32.402385 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96555621-9447-44b2-905d-f304548df074 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:32.405921 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96555621-9447-44b2-905d-f304548df074 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:32.405921 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96555621-9447-44b2-905d-f304548df074 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:32.405921 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96555621-9447-44b2-905d-f304548df074 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:32.405921 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96555621-9447-44b2-905d-f304548df074 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:32.406353 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-96555621-9447-44b2-905d-f304548df074 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:32.609773 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-96555621-9447-44b2-905d-f304548df074 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:32.618172 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-96555621-9447-44b2-905d-f304548df074 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1271 microversion: 2.1 time: 0.227853 Aug 18 12:28:32.618740 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 403/814] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:32 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:33.412568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-55073583-4367-4454-b539-c15e8c07a029 req-32a6ccbc-47a6-4b00-a248-9d17f87f73a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26fb4ea-80d1-405d-b693-2fe9cbe2f45c", "tag": "dc009460-8a64-46d7-ba37-594be57137d0"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:33.425010 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-55073583-4367-4454-b539-c15e8c07a029 req-32a6ccbc-47a6-4b00-a248-9d17f87f73a9 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:33.425751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-55073583-4367-4454-b539-c15e8c07a029 req-32a6ccbc-47a6-4b00-a248-9d17f87f73a9 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:33.431330 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-55073583-4367-4454-b539-c15e8c07a029 req-32a6ccbc-47a6-4b00-a248-9d17f87f73a9 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:33.439486 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-55073583-4367-4454-b539-c15e8c07a029 req-32a6ccbc-47a6-4b00-a248-9d17f87f73a9 service nova] Creating event network-changed:dc009460-8a64-46d7-ba37-594be57137d0 for instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c on hv-cinder-83602 Aug 18 12:28:33.444421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-55073583-4367-4454-b539-c15e8c07a029 req-32a6ccbc-47a6-4b00-a248-9d17f87f73a9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036278 Aug 18 12:28:33.445036 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 412/815] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:28:33.642551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-53124554-354e-4efb-b276-7a0cff05ea99 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:33.643598 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-53124554-354e-4efb-b276-7a0cff05ea99 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:33.651108 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53124554-354e-4efb-b276-7a0cff05ea99 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:33.651997 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53124554-354e-4efb-b276-7a0cff05ea99 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:33.652535 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53124554-354e-4efb-b276-7a0cff05ea99 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:33.653757 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53124554-354e-4efb-b276-7a0cff05ea99 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:33.654357 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53124554-354e-4efb-b276-7a0cff05ea99 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:33.655052 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-53124554-354e-4efb-b276-7a0cff05ea99 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:33.835257 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-53124554-354e-4efb-b276-7a0cff05ea99 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:33.846333 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-53124554-354e-4efb-b276-7a0cff05ea99 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1259 microversion: 2.1 time: 0.208489 Aug 18 12:28:33.847608 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 404/816] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:33 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:34.872373 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b5346066-a3a3-4938-85a8-463194f39733 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:34.873071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b5346066-a3a3-4938-85a8-463194f39733 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:34.879268 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5346066-a3a3-4938-85a8-463194f39733 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:34.882764 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5346066-a3a3-4938-85a8-463194f39733 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:34.882764 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5346066-a3a3-4938-85a8-463194f39733 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:34.882764 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5346066-a3a3-4938-85a8-463194f39733 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:34.882764 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5346066-a3a3-4938-85a8-463194f39733 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:34.883179 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5346066-a3a3-4938-85a8-463194f39733 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:35.013287 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b5346066-a3a3-4938-85a8-463194f39733 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:35.021650 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b5346066-a3a3-4938-85a8-463194f39733 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1259 microversion: 2.1 time: 0.153898 Aug 18 12:28:35.022230 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 413/817] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:34 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:36.044440 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-7cb2a72f-2ac8-46e0-beb9-066ac1745caa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:36.045330 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-7cb2a72f-2ac8-46e0-beb9-066ac1745caa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:36.052643 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7cb2a72f-2ac8-46e0-beb9-066ac1745caa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:36.053391 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7cb2a72f-2ac8-46e0-beb9-066ac1745caa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:36.053826 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7cb2a72f-2ac8-46e0-beb9-066ac1745caa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:36.054699 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7cb2a72f-2ac8-46e0-beb9-066ac1745caa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:36.055320 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7cb2a72f-2ac8-46e0-beb9-066ac1745caa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:36.055913 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7cb2a72f-2ac8-46e0-beb9-066ac1745caa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:36.237554 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-7cb2a72f-2ac8-46e0-beb9-066ac1745caa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:36.245807 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-7cb2a72f-2ac8-46e0-beb9-066ac1745caa tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1259 microversion: 2.1 time: 0.205123 Aug 18 12:28:36.246392 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 405/818] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:36 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:37.267141 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3a182716-2ce2-4dc9-99ae-3420c088d3c5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:37.267820 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3a182716-2ce2-4dc9-99ae-3420c088d3c5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:37.274943 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a182716-2ce2-4dc9-99ae-3420c088d3c5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:37.275515 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a182716-2ce2-4dc9-99ae-3420c088d3c5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:37.275957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a182716-2ce2-4dc9-99ae-3420c088d3c5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:37.276907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a182716-2ce2-4dc9-99ae-3420c088d3c5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:37.277169 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a182716-2ce2-4dc9-99ae-3420c088d3c5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:37.277665 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a182716-2ce2-4dc9-99ae-3420c088d3c5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:37.434664 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3a182716-2ce2-4dc9-99ae-3420c088d3c5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:37.454093 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3a182716-2ce2-4dc9-99ae-3420c088d3c5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1259 microversion: 2.1 time: 0.191637 Aug 18 12:28:37.455138 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 414/819] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:37 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:38.475325 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-061b66d6-1a3b-4297-9003-ae57f106204f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:38.476794 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-061b66d6-1a3b-4297-9003-ae57f106204f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:38.478950 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:38.484564 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-061b66d6-1a3b-4297-9003-ae57f106204f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:38.485062 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-061b66d6-1a3b-4297-9003-ae57f106204f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:38.485498 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-061b66d6-1a3b-4297-9003-ae57f106204f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:38.486209 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-061b66d6-1a3b-4297-9003-ae57f106204f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:38.486678 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-061b66d6-1a3b-4297-9003-ae57f106204f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:38.487148 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-061b66d6-1a3b-4297-9003-ae57f106204f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:38.779835 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-061b66d6-1a3b-4297-9003-ae57f106204f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:38.788053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-061b66d6-1a3b-4297-9003-ae57f106204f tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1259 microversion: 2.1 time: 0.316530 Aug 18 12:28:38.788783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 406/820] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:38 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1259 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:39.809733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0055e13f-1c33-4f17-a21f-29944906e4cd tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:39.811015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0055e13f-1c33-4f17-a21f-29944906e4cd tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:39.813696 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:39.818719 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0055e13f-1c33-4f17-a21f-29944906e4cd tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:39.819331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0055e13f-1c33-4f17-a21f-29944906e4cd tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:39.819899 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0055e13f-1c33-4f17-a21f-29944906e4cd tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:39.820702 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0055e13f-1c33-4f17-a21f-29944906e4cd tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:39.821382 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0055e13f-1c33-4f17-a21f-29944906e4cd tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:39.821906 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0055e13f-1c33-4f17-a21f-29944906e4cd tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:40.131221 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0055e13f-1c33-4f17-a21f-29944906e4cd tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:40.154498 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0055e13f-1c33-4f17-a21f-29944906e4cd tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1259 microversion: 2.1 time: 0.349142 Aug 18 12:28:40.156310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 415/821] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:39 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1259 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:41.176097 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-7d5e14a6-4372-4002-8aa5-f3f52e7b8d59 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:41.188026 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-7d5e14a6-4372-4002-8aa5-f3f52e7b8d59 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:41.201031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=8 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:41.202869 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7d5e14a6-4372-4002-8aa5-f3f52e7b8d59 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:41.204588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7d5e14a6-4372-4002-8aa5-f3f52e7b8d59 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:41.209813 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7d5e14a6-4372-4002-8aa5-f3f52e7b8d59 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:41.210572 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7d5e14a6-4372-4002-8aa5-f3f52e7b8d59 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:41.211137 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7d5e14a6-4372-4002-8aa5-f3f52e7b8d59 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:41.211599 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-7d5e14a6-4372-4002-8aa5-f3f52e7b8d59 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:41.382086 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-64e1fbab-bf70-4f30-907d-00cb79b01d81 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:41.384962 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-64e1fbab-bf70-4f30-907d-00cb79b01d81 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:41.392661 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64e1fbab-bf70-4f30-907d-00cb79b01d81 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:41.393503 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64e1fbab-bf70-4f30-907d-00cb79b01d81 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:41.394763 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64e1fbab-bf70-4f30-907d-00cb79b01d81 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:41.396014 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64e1fbab-bf70-4f30-907d-00cb79b01d81 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:41.396699 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64e1fbab-bf70-4f30-907d-00cb79b01d81 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:41.397329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-64e1fbab-bf70-4f30-907d-00cb79b01d81 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:41.434241 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-64e1fbab-bf70-4f30-907d-00cb79b01d81 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056030 Aug 18 12:28:41.435538 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 416/822] 10.222.0.98 () {60 vars in 1343 bytes} [Thu Aug 18 12:28:41 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:41.481536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-7d5e14a6-4372-4002-8aa5-f3f52e7b8d59 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:41.491210 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-7d5e14a6-4372-4002-8aa5-f3f52e7b8d59 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1259 microversion: 2.1 time: 0.318846 Aug 18 12:28:41.492267 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 407/823] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:41 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1259 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:41.539690 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-85e79285-25e1-408b-bce1-b4fea99d8300 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:41.540453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-85e79285-25e1-408b-bce1-b4fea99d8300 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:41.546734 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85e79285-25e1-408b-bce1-b4fea99d8300 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:41.547364 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85e79285-25e1-408b-bce1-b4fea99d8300 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:41.547890 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85e79285-25e1-408b-bce1-b4fea99d8300 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:41.548958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85e79285-25e1-408b-bce1-b4fea99d8300 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:41.549772 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85e79285-25e1-408b-bce1-b4fea99d8300 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:41.550499 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85e79285-25e1-408b-bce1-b4fea99d8300 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:41.583116 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-85e79285-25e1-408b-bce1-b4fea99d8300 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:28:41.916189 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-85e79285-25e1-408b-bce1-b4fea99d8300 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "DELETE /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 204 len: 0 microversion: 2.20 time: 0.380315 Aug 18 12:28:41.917045 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 417/824] 10.222.0.98 () {60 vars in 1280 bytes} [Thu Aug 18 12:28:41 2022] DELETE /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 12:28:41.926319 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:41.926940 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:41.933358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:41.933841 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:41.934273 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:41.934969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:41.935439 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:41.935879 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:42.070399 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:42.078813 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:42.080408 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:42.084297 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c1619643-e30f-4090-ab03-f117734f5732 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.160343 Aug 18 12:28:42.084297 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 408/825] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:41 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:28:42.513048 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cfed1637-fa29-4692-b103-46df8e045b32 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:42.513740 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-cfed1637-fa29-4692-b103-46df8e045b32 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:42.524948 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfed1637-fa29-4692-b103-46df8e045b32 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:42.525768 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfed1637-fa29-4692-b103-46df8e045b32 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:42.529265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfed1637-fa29-4692-b103-46df8e045b32 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:42.529265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfed1637-fa29-4692-b103-46df8e045b32 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:42.529265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfed1637-fa29-4692-b103-46df8e045b32 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:42.529265 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-cfed1637-fa29-4692-b103-46df8e045b32 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:42.688976 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-cfed1637-fa29-4692-b103-46df8e045b32 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:42.698222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cfed1637-fa29-4692-b103-46df8e045b32 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1259 microversion: 2.1 time: 0.189252 Aug 18 12:28:42.698807 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 418/826] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:42 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:43.108272 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:43.110659 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:43.118884 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:43.119485 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:43.120106 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:43.121297 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:43.121765 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:43.123221 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:43.400581 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:43.409523 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:43.411329 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:43.412597 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-60d21369-70ec-4e78-9f09-b117c31a665c tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1722 microversion: 2.20 time: 0.311260 Aug 18 12:28:43.413605 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 409/827] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:43 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:28:43.720339 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1e6e9e3d-58b0-4ca7-9dc7-b2828240c635 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:43.721746 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1e6e9e3d-58b0-4ca7-9dc7-b2828240c635 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:43.731388 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e3d-58b0-4ca7-9dc7-b2828240c635 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:43.731785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e3d-58b0-4ca7-9dc7-b2828240c635 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:43.732503 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e3d-58b0-4ca7-9dc7-b2828240c635 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:43.733345 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e3d-58b0-4ca7-9dc7-b2828240c635 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:43.733870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e3d-58b0-4ca7-9dc7-b2828240c635 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:43.735166 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e3d-58b0-4ca7-9dc7-b2828240c635 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:43.891454 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1e6e9e3d-58b0-4ca7-9dc7-b2828240c635 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:43.899568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1e6e9e3d-58b0-4ca7-9dc7-b2828240c635 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1259 microversion: 2.1 time: 0.184180 Aug 18 12:28:43.900127 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 419/828] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:43 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:44.435788 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:44.436564 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:44.443969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:44.444537 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:44.445194 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:44.446007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:44.446441 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:44.446863 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:44.558930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:44.573572 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:44.576841 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:44.579577 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-999f800e-eb34-4ad0-bf92-1054f2d448bd tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1655 microversion: 2.20 time: 0.147844 Aug 18 12:28:44.580384 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 410/829] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:44 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:28:44.754622 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-e717ba52-9455-4393-a22d-396e3d8b0ddc req-7a7ee332-36b2-4125-b35a-7cae64abc961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26fb4ea-80d1-405d-b693-2fe9cbe2f45c", "name": "network-vif-plugged", "status": "completed", "tag": "dc009460-8a64-46d7-ba37-594be57137d0"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:44.775020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-e717ba52-9455-4393-a22d-396e3d8b0ddc req-7a7ee332-36b2-4125-b35a-7cae64abc961 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:44.776541 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-e717ba52-9455-4393-a22d-396e3d8b0ddc req-7a7ee332-36b2-4125-b35a-7cae64abc961 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:44.778388 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-e717ba52-9455-4393-a22d-396e3d8b0ddc req-7a7ee332-36b2-4125-b35a-7cae64abc961 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:44.807606 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-e717ba52-9455-4393-a22d-396e3d8b0ddc req-7a7ee332-36b2-4125-b35a-7cae64abc961 service nova] Creating event network-vif-plugged:dc009460-8a64-46d7-ba37-594be57137d0 for instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c on hv-cinder-83602 Aug 18 12:28:44.817523 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-e717ba52-9455-4393-a22d-396e3d8b0ddc req-7a7ee332-36b2-4125-b35a-7cae64abc961 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066127 Aug 18 12:28:44.819687 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 420/830] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:28:44.922037 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-37014ae9-ae3a-4ca5-85db-891068912341 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:44.923048 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-37014ae9-ae3a-4ca5-85db-891068912341 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:44.931286 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37014ae9-ae3a-4ca5-85db-891068912341 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:44.935342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37014ae9-ae3a-4ca5-85db-891068912341 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:44.936061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37014ae9-ae3a-4ca5-85db-891068912341 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:44.940154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37014ae9-ae3a-4ca5-85db-891068912341 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:44.940815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37014ae9-ae3a-4ca5-85db-891068912341 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:44.941420 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-37014ae9-ae3a-4ca5-85db-891068912341 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:45.015935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-f73348fc-36f4-4651-97cc-763b97ae5c16 req-78166b55-e217-46bf-8e0f-18f597f94ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f0a98d-091a-4d0c-8e84-79fbb60d71a8", "name": "network-vif-deleted", "tag": "5ed6bae6-8e44-4797-93ff-eaa620fb9744"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:45.056025 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f73348fc-36f4-4651-97cc-763b97ae5c16 req-78166b55-e217-46bf-8e0f-18f597f94ea5 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:45.058947 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f73348fc-36f4-4651-97cc-763b97ae5c16 req-78166b55-e217-46bf-8e0f-18f597f94ea5 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:45.059915 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f73348fc-36f4-4651-97cc-763b97ae5c16 req-78166b55-e217-46bf-8e0f-18f597f94ea5 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:45.077287 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-f73348fc-36f4-4651-97cc-763b97ae5c16 req-78166b55-e217-46bf-8e0f-18f597f94ea5 service nova] Creating event network-vif-deleted:5ed6bae6-8e44-4797-93ff-eaa620fb9744 for instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 on hv-cinder-83602 Aug 18 12:28:45.083934 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-f73348fc-36f4-4651-97cc-763b97ae5c16 req-78166b55-e217-46bf-8e0f-18f597f94ea5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086803 Aug 18 12:28:45.085702 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 421/831] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:28:45.173909 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-37014ae9-ae3a-4ca5-85db-891068912341 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:45.182684 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-37014ae9-ae3a-4ca5-85db-891068912341 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1259 microversion: 2.1 time: 0.265388 Aug 18 12:28:45.183714 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 411/832] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:44 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1259 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:45.607261 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:45.608453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:45.616453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:45.619121 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:45.619121 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:45.619121 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:45.619745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:45.620377 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:45.679173 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:45.681672 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:45.682292 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:45.683508 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lazy-loading 'fault' on Instance uuid 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:28:45.747985 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:45.758229 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:45.770515 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd98949bd624a4330a473ebe5de31586a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccf2ca9a634becb2eee93fddbd2258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:45.771994 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ad154ee1-0ced-40bf-970b-1257108200c2 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 200 len: 1371 microversion: 2.20 time: 0.169352 Aug 18 12:28:45.772529 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 422/833] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:45 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 12:28:46.213620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-674c285e-93f1-4204-835f-a2c51c4350a5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:46.213620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-674c285e-93f1-4204-835f-a2c51c4350a5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:46.225685 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674c285e-93f1-4204-835f-a2c51c4350a5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:46.226188 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674c285e-93f1-4204-835f-a2c51c4350a5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:46.226632 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674c285e-93f1-4204-835f-a2c51c4350a5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:46.227363 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674c285e-93f1-4204-835f-a2c51c4350a5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:46.227998 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674c285e-93f1-4204-835f-a2c51c4350a5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:46.228435 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674c285e-93f1-4204-835f-a2c51c4350a5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:46.571024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-674c285e-93f1-4204-835f-a2c51c4350a5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:46.580167 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-674c285e-93f1-4204-835f-a2c51c4350a5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1259 microversion: 2.1 time: 0.380708 Aug 18 12:28:46.585313 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 412/834] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:46 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1259 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:46.794205 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:46.794818 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:46.805806 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:46.806674 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:46.807263 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:46.808307 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:46.808912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:46.810797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:46.828409 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] HTTP exception thrown: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Request method failure captured: Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 HTTP/1.1 Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i7zsB3dzbqxXgw1doijld1_rvMQqgqONX35Wg7g7dMwlFHPwbdR58-flVBXroxwq4z98q9Wju9Af7x0TlMzyG2wECkFX4lcHV6mToUl-4XbuVvgQfwenJvvZcufI-0X2Ky8X3wTi0BtcUEbiqxKvKB467K9Ztf_vixdSrFd9ZDmTwo Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:28:46.831644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: d98949bd624a4330a473ebe5de31586a Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:46.836817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '49f0a98d-091a-4d0c-8e84-79fbb60d71a8'} Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:28:46.837835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:46.840101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:46.841788 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Returning 404 to user: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:28:46.841788 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fb1cb57c-420c-43de-bfc8-8e0175e6f90f tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 404 len: 111 microversion: 2.20 time: 0.043251 Aug 18 12:28:46.841788 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 423/835] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:46 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 12:28:46.844242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-17b4f0e3-bc43-40de-aedd-f82dd335fa30 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '.version_select at 0x7f3787ea1940>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:46.929546 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-17b4f0e3-bc43-40de-aedd-f82dd335fa30 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094065810" status: 204 len: 0 microversion: 2.20 time: 0.090184 Aug 18 12:28:46.930943 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 413/836] 10.222.0.98 () {60 vars in 1262 bytes} [Thu Aug 18 12:28:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094065810 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 12:28:47.608156 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8b22187e-6b8e-4124-b1ad-a49f87b76cb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:47.608750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8b22187e-6b8e-4124-b1ad-a49f87b76cb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:47.620240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b22187e-6b8e-4124-b1ad-a49f87b76cb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:47.621582 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b22187e-6b8e-4124-b1ad-a49f87b76cb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:47.624328 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b22187e-6b8e-4124-b1ad-a49f87b76cb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:47.624328 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b22187e-6b8e-4124-b1ad-a49f87b76cb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:47.625459 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b22187e-6b8e-4124-b1ad-a49f87b76cb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:47.626363 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8b22187e-6b8e-4124-b1ad-a49f87b76cb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:47.862763 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8b22187e-6b8e-4124-b1ad-a49f87b76cb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:47.876387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8b22187e-6b8e-4124-b1ad-a49f87b76cb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1443 microversion: 2.1 time: 0.273318 Aug 18 12:28:47.877113 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 424/837] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:47 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1443 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:47.897313 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b2b3b955-3aa3-4c8f-9a8f-953df60431df tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:47.898571 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b2b3b955-3aa3-4c8f-9a8f-953df60431df tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:47.911815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2b3b955-3aa3-4c8f-9a8f-953df60431df tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:47.914151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2b3b955-3aa3-4c8f-9a8f-953df60431df tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:47.914788 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2b3b955-3aa3-4c8f-9a8f-953df60431df tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:47.917645 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2b3b955-3aa3-4c8f-9a8f-953df60431df tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:47.919047 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2b3b955-3aa3-4c8f-9a8f-953df60431df tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:47.919581 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b2b3b955-3aa3-4c8f-9a8f-953df60431df tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:48.090012 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b2b3b955-3aa3-4c8f-9a8f-953df60431df tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:48.099668 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b2b3b955-3aa3-4c8f-9a8f-953df60431df tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1443 microversion: 2.1 time: 0.206866 Aug 18 12:28:48.100829 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 414/838] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:47 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1443 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:49.386857 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:49.387635 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:49.396962 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:49.397870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:49.398570 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:49.399609 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:49.400944 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:49.401606 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:49.429066 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] HTTP exception thrown: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Request method failure captured: Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: DELETE /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 HTTP/1.1 Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i7zsB3dzbqxXgw1doijld1_rvMQqgqONX35Wg7g7dMwlFHPwbdR58-flVBXroxwq4z98q9Wju9Af7x0TlMzyG2wECkFX4lcHV6mToUl-4XbuVvgQfwenJvvZcufI-0X2Ky8X3wTi0BtcUEbiqxKvKB467K9Ztf_vixdSrFd9ZDmTwo Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:28:49.430922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: d98949bd624a4330a473ebe5de31586a Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:49.432403 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '49f0a98d-091a-4d0c-8e84-79fbb60d71a8'} Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:28:49.433157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:49.434551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:49.438291 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Returning 404 to user: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:28:49.439469 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-166c9fff-d4ce-418f-9b7e-afff13ef8741 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "DELETE /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 404 len: 111 microversion: 2.20 time: 0.056738 Aug 18 12:28:49.449871 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:49.451149 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 49f0a98d-091a-4d0c-8e84-79fbb60d71a8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:49.457224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 425/839] 10.222.0.98 () {60 vars in 1280 bytes} [Thu Aug 18 12:28:49 2022] DELETE /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 12:28:49.462349 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:49.463099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:49.463632 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:49.464420 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:49.464996 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:49.465491 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:49.490442 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] HTTP exception thrown: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Request method failure captured: Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 HTTP/1.1 Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i7zsB3dzbqxXgw1doijld1_rvMQqgqONX35Wg7g7dMwlFHPwbdR58-flVBXroxwq4z98q9Wju9Af7x0TlMzyG2wECkFX4lcHV6mToUl-4XbuVvgQfwenJvvZcufI-0X2Ky8X3wTi0BtcUEbiqxKvKB467K9Ztf_vixdSrFd9ZDmTwo Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:28:49.493050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: d98949bd624a4330a473ebe5de31586a Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:49.494473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '49f0a98d-091a-4d0c-8e84-79fbb60d71a8'} Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:28:49.495251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. Aug 18 12:28:49.496556 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:49.500870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Returning 404 to user: Instance 49f0a98d-091a-4d0c-8e84-79fbb60d71a8 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:28:49.502155 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d83046bc-43f3-465d-a93b-26c16d3da730 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8" status: 404 len: 111 microversion: 2.20 time: 0.057431 Aug 18 12:28:49.503727 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 415/840] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:49 2022] GET /compute/v2.1/servers/49f0a98d-091a-4d0c-8e84-79fbb60d71a8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 12:28:50.030512 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1f0aac48-d314-48a1-94d2-93ee9faca17e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Action: 'create', calling method: .version_select at 0x7f3787fc6670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-229203386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJsXmJQx8MBHlHGDKuGHltLpRX7bEqD+vZBDeVlQH6bp43RyFtM6wcgcOP2YFoLJ6icS2MwEiP0CB400EGibhqeRKt7QeMU7nPqoekGWneKse2MiQffsFeE+X6aGqcLrg=="}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:50.049113 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-1f0aac48-d314-48a1-94d2-93ee9faca17e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Getting quotas for project c1534d6a880c4f44b741ff5b208663bc. Resources: {'key_pairs'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:28:50.054202 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-1f0aac48-d314-48a1-94d2-93ee9faca17e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Getting quotas for user 3907830851364a73b4d3715280a132bc and project c1534d6a880c4f44b741ff5b208663bc. Resources: {'key_pairs'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:28:50.161625 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1f0aac48-d314-48a1-94d2-93ee9faca17e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.351986 Aug 18 12:28:50.162245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 426/841] 10.222.0.98 () {60 vars in 1159 bytes} [Thu Aug 18 12:28:49 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:28:50.798176 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:50.798771 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:50.805970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:50.806725 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:50.807441 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:50.808307 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:50.808770 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:50.809195 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:50.827303 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] HTTP exception thrown: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Request method failure captured: Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: DELETE /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb HTTP/1.1 Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_i7zsB3dzbqxXgw1doijld1_rvMQqgqONX35Wg7g7dMwlFHPwbdR58-flVBXroxwq4z98q9Wju9Af7x0TlMzyG2wECkFX4lcHV6mToUl-4XbuVvgQfwenJvvZcufI-0X2Ky8X3wTi0BtcUEbiqxKvKB467K9Ztf_vixdSrFd9ZDmTwo Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:28:50.829322 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: d98949bd624a4330a473ebe5de31586a Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:28:50.831031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '9c4dfc92-fb5b-46f3-a14a-992de65d7adb'} Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:28:50.836832 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:28:50.838236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:28:50.839552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Returning 404 to user: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:28:50.839552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8b538f9e-51d7-4729-b5ae-82d11c94a8b4 tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 404 len: 111 microversion: 2.20 time: 0.041260 Aug 18 12:28:50.839552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 416/842] 10.222.0.98 () {60 vars in 1280 bytes} [Thu Aug 18 12:28:50 2022] DELETE /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 12:28:50.846211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:50.846865 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] [instance: 9c4dfc92-fb5b-46f3-a14a-992de65d7adb] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:50.856697 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:50.857206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:50.857712 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:50.858432 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:50.859819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:50.860250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:50.876728 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] HTTP exception thrown: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Request method failure captured: Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb HTTP/1.1 Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_i7zsB3dzbqxXgw1doijld1_rvMQqgqONX35Wg7g7dMwlFHPwbdR58-flVBXroxwq4z98q9Wju9Af7x0TlMzyG2wECkFX4lcHV6mToUl-4XbuVvgQfwenJvvZcufI-0X2Ky8X3wTi0BtcUEbiqxKvKB467K9Ztf_vixdSrFd9ZDmTwo Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:28:50.878310 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_80ccf2ca9a634becb2eee93fddbd2258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 80ccf2ca9a634becb2eee93fddbd2258 Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-271265148 Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: d98949bd624a4330a473ebe5de31586a Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeShelveTestJSON-271265148-project Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:28:50.879793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '9c4dfc92-fb5b-46f3-a14a-992de65d7adb'} Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:28:50.880557 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. Aug 18 12:28:50.881860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:28:50.883045 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] Returning 404 to user: Instance 9c4dfc92-fb5b-46f3-a14a-992de65d7adb could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:28:50.883045 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4bde16b5-fe46-4a2e-8a14-433df8a90c2e tempest-AttachVolumeShelveTestJSON-271265148 tempest-AttachVolumeShelveTestJSON-271265148-project] 10.222.0.98 "GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb" status: 404 len: 111 microversion: 2.20 time: 0.041289 Aug 18 12:28:50.886302 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 427/843] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Aug 18 12:28:50 2022] GET /compute/v2.1/servers/9c4dfc92-fb5b-46f3-a14a-992de65d7adb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 12:28:51.479330 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-75177e8f-6c6b-4c80-a4e7-83fca3aadb35 req-914be696-19f5-42ea-9822-b2325283185a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26fb4ea-80d1-405d-b693-2fe9cbe2f45c", "tag": "dc009460-8a64-46d7-ba37-594be57137d0"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:51.492571 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-75177e8f-6c6b-4c80-a4e7-83fca3aadb35 req-914be696-19f5-42ea-9822-b2325283185a service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:51.493425 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-75177e8f-6c6b-4c80-a4e7-83fca3aadb35 req-914be696-19f5-42ea-9822-b2325283185a service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:51.494077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-75177e8f-6c6b-4c80-a4e7-83fca3aadb35 req-914be696-19f5-42ea-9822-b2325283185a service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:51.508786 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-75177e8f-6c6b-4c80-a4e7-83fca3aadb35 req-914be696-19f5-42ea-9822-b2325283185a service nova] Creating event network-changed:dc009460-8a64-46d7-ba37-594be57137d0 for instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c on hv-cinder-83602 Aug 18 12:28:51.516667 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-75177e8f-6c6b-4c80-a4e7-83fca3aadb35 req-914be696-19f5-42ea-9822-b2325283185a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041740 Aug 18 12:28:51.517589 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 417/844] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:29:02.540616 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=4 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:02.541665 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:02.542305 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:02.670013 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7a154634-2d64-4c6d-ad5d-06404ca9bfe5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: .version_select at 0x7f37988fea60>, body: {"keypair": {"name": "tempest-keypair-334638729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn1ZFVqThBDGXvwSQvyQ0FhHnuqg49Iht2gHg08Oe5UmS4RYMAZ2VM1fXVUHNMOD7zyug884bfTy6IP/5D5Zo4xoI8jztFTF/OJ3eJgkkg23Ywtsa+WbgFti7ABTi7yfA=="}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:02.687469 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-7a154634-2d64-4c6d-ad5d-06404ca9bfe5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'key_pairs'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:29:02.697067 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-7a154634-2d64-4c6d-ad5d-06404ca9bfe5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for user 27ed3f0ca7c44672a42aa774b02de88c and project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'key_pairs'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:29:02.831241 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7a154634-2d64-4c6d-ad5d-06404ca9bfe5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.295896 Aug 18 12:29:02.831903 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 428/845] 10.222.0.98 () {60 vars in 1159 bytes} [Thu Aug 18 12:29:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:29:05.147487 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-564492351", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e16b12d6-9788-4022-91a7-d06421bd0ecc"}], "security_groups": [{"name": "tempest-securitygroup--1961443313"}], "key_name": "tempest-keypair-334638729", "user_data": "}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:05.158028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:05.164133 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=74 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:05.264933 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] validate_networks() for [('e16b12d6-9788-4022-91a7-d06421bd0ecc', None, None, None, None, None)] {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:29:05.671016 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:29:05.671468 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:29:05.671957 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:29:05.672365 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:29:05.673157 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:29:05.682505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:05.683212 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:05.683850 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:05.684608 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:05.685067 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:05.685495 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:05.703174 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:29:05.707460 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for user 27ed3f0ca7c44672a42aa774b02de88c and project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:29:05.719687 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:29:05.722072 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:29:05.917678 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-137201de-0633-439b-a594-615c3fc2dd69 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.777784 Aug 18 12:29:05.918326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 418/846] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:29:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:29:05.929249 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8e777a18-4ba3-447b-ac31-5cf61d9a7c6f tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:05.929858 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8e777a18-4ba3-447b-ac31-5cf61d9a7c6f tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:05.986251 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8e777a18-4ba3-447b-ac31-5cf61d9a7c6f tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:05.993587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8e777a18-4ba3-447b-ac31-5cf61d9a7c6f tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1240 microversion: 2.1 time: 0.068374 Aug 18 12:29:05.994210 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 429/847] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:05 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:07.014686 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-9e78089d-9ed7-419d-88aa-bb664393a28b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:07.015704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-9e78089d-9ed7-419d-88aa-bb664393a28b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:07.023615 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9e78089d-9ed7-419d-88aa-bb664393a28b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:07.024111 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9e78089d-9ed7-419d-88aa-bb664393a28b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:07.027842 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9e78089d-9ed7-419d-88aa-bb664393a28b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:07.027842 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9e78089d-9ed7-419d-88aa-bb664393a28b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:07.027842 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9e78089d-9ed7-419d-88aa-bb664393a28b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:07.027842 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9e78089d-9ed7-419d-88aa-bb664393a28b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:07.095565 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-9e78089d-9ed7-419d-88aa-bb664393a28b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:07.103376 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-9e78089d-9ed7-419d-88aa-bb664393a28b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1244 microversion: 2.1 time: 0.093181 Aug 18 12:29:07.104024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 419/848] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:07 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:08.124485 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ad58dff7-8caf-46b8-806f-a864f70272dc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:08.125115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ad58dff7-8caf-46b8-806f-a864f70272dc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:08.131615 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad58dff7-8caf-46b8-806f-a864f70272dc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:08.132094 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad58dff7-8caf-46b8-806f-a864f70272dc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:08.132525 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad58dff7-8caf-46b8-806f-a864f70272dc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:08.133207 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad58dff7-8caf-46b8-806f-a864f70272dc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:08.133655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad58dff7-8caf-46b8-806f-a864f70272dc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:08.134074 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ad58dff7-8caf-46b8-806f-a864f70272dc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:08.200710 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ad58dff7-8caf-46b8-806f-a864f70272dc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:08.209411 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ad58dff7-8caf-46b8-806f-a864f70272dc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1292 microversion: 2.1 time: 0.088698 Aug 18 12:29:08.210357 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 430/849] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:08 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:09.230941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5939f83d-51c2-4907-a11f-e2a569bbdb50 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:09.231742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5939f83d-51c2-4907-a11f-e2a569bbdb50 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:09.239679 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5939f83d-51c2-4907-a11f-e2a569bbdb50 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:09.240205 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5939f83d-51c2-4907-a11f-e2a569bbdb50 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:09.240643 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5939f83d-51c2-4907-a11f-e2a569bbdb50 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:09.241414 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5939f83d-51c2-4907-a11f-e2a569bbdb50 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:09.241903 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5939f83d-51c2-4907-a11f-e2a569bbdb50 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:09.242381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5939f83d-51c2-4907-a11f-e2a569bbdb50 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:09.441742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5939f83d-51c2-4907-a11f-e2a569bbdb50 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:09.450213 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5939f83d-51c2-4907-a11f-e2a569bbdb50 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1366 microversion: 2.1 time: 0.223690 Aug 18 12:29:09.450944 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 420/850] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:09 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:09.661050 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1775052659", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-229203386", "security_groups": [{"name": "tempest-secgroup-smoke-2046157390"}], "block_device_mapping_v2": [{"uuid": "15bde9cd-bf3c-4954-bb91-a66b2061e150", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4f234a1b-725a-4b27-82c4-838eed1ed10a"}]}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:09.776224 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.network.neutron [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] validate_networks() for [('4f234a1b-725a-4b27-82c4-838eed1ed10a', None, None, None, None, None)] {{(pid=121245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:29:10.159253 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Flavor limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:29:10.160168 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Image limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:29:10.161000 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Flavor pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:29:10.161581 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Image pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:29:10.161910 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-58905ce5-3b12-49ab-981a-284e7f4fd843 req-62728530-3130-4646-9905-055e4ae4cfcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3757ba7d-3058-4402-809d-f211ff48ab91", "tag": "c39795df-aa38-41cd-a915-613253053131"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:10.162342 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:29:10.173296 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:10.174025 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:10.174615 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:10.175643 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:10.176397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:10.177069 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:10.181939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-58905ce5-3b12-49ab-981a-284e7f4fd843 req-62728530-3130-4646-9905-055e4ae4cfcb service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:10.182298 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-58905ce5-3b12-49ab-981a-284e7f4fd843 req-62728530-3130-4646-9905-055e4ae4cfcb service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:10.182803 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-58905ce5-3b12-49ab-981a-284e7f4fd843 req-62728530-3130-4646-9905-055e4ae4cfcb service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:10.198284 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-58905ce5-3b12-49ab-981a-284e7f4fd843 req-62728530-3130-4646-9905-055e4ae4cfcb service nova] Creating event network-changed:c39795df-aa38-41cd-a915-613253053131 for instance 3757ba7d-3058-4402-809d-f211ff48ab91 on hv-cinder-83602 Aug 18 12:29:10.198534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Getting quotas for project c1534d6a880c4f44b741ff5b208663bc. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:29:10.203226 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Getting quotas for user 3907830851364a73b4d3715280a132bc and project c1534d6a880c4f44b741ff5b208663bc. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:29:10.203639 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-58905ce5-3b12-49ab-981a-284e7f4fd843 req-62728530-3130-4646-9905-055e4ae4cfcb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045824 Aug 18 12:29:10.205348 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 421/851] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:29:10.276947 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Going to run 1 instances... {{(pid=121245) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:29:10.279182 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15bde9cd-bf3c-4954-bb91-a66b2061e150',volume_size=None,volume_type=None)] {{(pid=121245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:29:10.473206 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2a6c4574-013d-452b-a3bd-f8235693527b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:10.473924 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2a6c4574-013d-452b-a3bd-f8235693527b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:10.480474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a6c4574-013d-452b-a3bd-f8235693527b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:10.484633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a6c4574-013d-452b-a3bd-f8235693527b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:10.484633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a6c4574-013d-452b-a3bd-f8235693527b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:10.484633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a6c4574-013d-452b-a3bd-f8235693527b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:10.484633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a6c4574-013d-452b-a3bd-f8235693527b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:10.485019 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2a6c4574-013d-452b-a3bd-f8235693527b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:10.682091 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8d33bf0e-1ba7-4143-a864-65917634f5b6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.025208 Aug 18 12:29:10.682752 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 431/852] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:29:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:29:10.694698 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-82706dab-b94e-42a2-8776-1f00cb759c13 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:10.695693 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-82706dab-b94e-42a2-8776-1f00cb759c13 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:10.718982 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2a6c4574-013d-452b-a3bd-f8235693527b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:10.727765 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2a6c4574-013d-452b-a3bd-f8235693527b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1366 microversion: 2.1 time: 0.259732 Aug 18 12:29:10.740415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 422/853] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:10 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:10.766107 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-82706dab-b94e-42a2-8776-1f00cb759c13 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:10.774355 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-82706dab-b94e-42a2-8776-1f00cb759c13 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1094 microversion: 2.1 time: 0.083671 Aug 18 12:29:10.774965 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 432/854] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:10 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:11.750087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-755f1caa-f4aa-48ff-bb9a-9963b97b0f70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:11.751328 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-755f1caa-f4aa-48ff-bb9a-9963b97b0f70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:11.758143 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-755f1caa-f4aa-48ff-bb9a-9963b97b0f70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:11.758620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-755f1caa-f4aa-48ff-bb9a-9963b97b0f70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:11.759055 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-755f1caa-f4aa-48ff-bb9a-9963b97b0f70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:11.759938 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-755f1caa-f4aa-48ff-bb9a-9963b97b0f70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:11.760395 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-755f1caa-f4aa-48ff-bb9a-9963b97b0f70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:11.760822 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-755f1caa-f4aa-48ff-bb9a-9963b97b0f70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:11.795065 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3a38c039-7342-4776-b4dd-407961a8d9c6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:11.795641 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3a38c039-7342-4776-b4dd-407961a8d9c6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:11.805595 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a38c039-7342-4776-b4dd-407961a8d9c6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:11.810583 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a38c039-7342-4776-b4dd-407961a8d9c6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:11.810583 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a38c039-7342-4776-b4dd-407961a8d9c6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:11.810583 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a38c039-7342-4776-b4dd-407961a8d9c6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:11.810583 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a38c039-7342-4776-b4dd-407961a8d9c6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:11.810947 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3a38c039-7342-4776-b4dd-407961a8d9c6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:11.870782 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3a38c039-7342-4776-b4dd-407961a8d9c6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:11.878994 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3a38c039-7342-4776-b4dd-407961a8d9c6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1144 microversion: 2.1 time: 0.088588 Aug 18 12:29:11.879565 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 433/855] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:11 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:11.896319 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-755f1caa-f4aa-48ff-bb9a-9963b97b0f70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:11.904857 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-755f1caa-f4aa-48ff-bb9a-9963b97b0f70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1366 microversion: 2.1 time: 0.158695 Aug 18 12:29:11.905420 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 423/856] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:11 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:12.900862 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-9db47d87-79f6-47b9-9054-47917e2e3d7b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:12.901597 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-9db47d87-79f6-47b9-9054-47917e2e3d7b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:12.908969 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9db47d87-79f6-47b9-9054-47917e2e3d7b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:12.909690 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9db47d87-79f6-47b9-9054-47917e2e3d7b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:12.910132 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9db47d87-79f6-47b9-9054-47917e2e3d7b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:12.910864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9db47d87-79f6-47b9-9054-47917e2e3d7b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:12.911316 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9db47d87-79f6-47b9-9054-47917e2e3d7b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:12.911853 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9db47d87-79f6-47b9-9054-47917e2e3d7b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:12.925812 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-592fb492-b76d-4b70-b593-b8212d29ab7b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:12.926420 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-592fb492-b76d-4b70-b593-b8212d29ab7b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:12.935687 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-592fb492-b76d-4b70-b593-b8212d29ab7b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:12.937849 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-592fb492-b76d-4b70-b593-b8212d29ab7b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:12.939104 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-592fb492-b76d-4b70-b593-b8212d29ab7b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:12.940300 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-592fb492-b76d-4b70-b593-b8212d29ab7b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:12.941199 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-592fb492-b76d-4b70-b593-b8212d29ab7b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:12.943200 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-592fb492-b76d-4b70-b593-b8212d29ab7b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:13.003520 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-9db47d87-79f6-47b9-9054-47917e2e3d7b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:13.012709 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-9db47d87-79f6-47b9-9054-47917e2e3d7b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1200 microversion: 2.1 time: 0.116881 Aug 18 12:29:13.027343 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 434/857] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:12 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1200 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:13.282089 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-592fb492-b76d-4b70-b593-b8212d29ab7b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:13.290845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-592fb492-b76d-4b70-b593-b8212d29ab7b tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1366 microversion: 2.1 time: 0.368961 Aug 18 12:29:13.291503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 424/858] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:12 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:14.034180 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b8beb8e7-8d57-4ba1-afff-be31eb20840c tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:14.035040 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b8beb8e7-8d57-4ba1-afff-be31eb20840c tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:14.041635 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8beb8e7-8d57-4ba1-afff-be31eb20840c tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:14.042214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8beb8e7-8d57-4ba1-afff-be31eb20840c tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:14.042722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8beb8e7-8d57-4ba1-afff-be31eb20840c tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:14.043446 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8beb8e7-8d57-4ba1-afff-be31eb20840c tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:14.043934 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8beb8e7-8d57-4ba1-afff-be31eb20840c tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:14.044360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b8beb8e7-8d57-4ba1-afff-be31eb20840c tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:14.186779 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b8beb8e7-8d57-4ba1-afff-be31eb20840c tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:14.195508 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b8beb8e7-8d57-4ba1-afff-be31eb20840c tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1278 microversion: 2.1 time: 0.165134 Aug 18 12:29:14.196082 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 435/859] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:14 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:14.317743 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-700b79f6-ddb4-4c70-90f9-85f817896bc8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:14.318724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-700b79f6-ddb4-4c70-90f9-85f817896bc8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:14.327239 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-700b79f6-ddb4-4c70-90f9-85f817896bc8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:14.327897 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-700b79f6-ddb4-4c70-90f9-85f817896bc8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:14.329229 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-700b79f6-ddb4-4c70-90f9-85f817896bc8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:14.330051 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-700b79f6-ddb4-4c70-90f9-85f817896bc8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:14.330631 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-700b79f6-ddb4-4c70-90f9-85f817896bc8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:14.331892 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-700b79f6-ddb4-4c70-90f9-85f817896bc8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:14.538893 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-700b79f6-ddb4-4c70-90f9-85f817896bc8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:14.539334 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-f977cca6-757d-4c69-a947-98b73f488612 req-168818c5-6cc0-4364-8e00-58a408ddf0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3757ba7d-3058-4402-809d-f211ff48ab91", "name": "network-vif-plugged", "status": "completed", "tag": "c39795df-aa38-41cd-a915-613253053131"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:14.551652 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-700b79f6-ddb4-4c70-90f9-85f817896bc8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1366 microversion: 2.1 time: 0.238262 Aug 18 12:29:14.552233 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 425/860] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:14 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:14.563751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f977cca6-757d-4c69-a947-98b73f488612 req-168818c5-6cc0-4364-8e00-58a408ddf0a1 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:14.563751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f977cca6-757d-4c69-a947-98b73f488612 req-168818c5-6cc0-4364-8e00-58a408ddf0a1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:14.563751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-f977cca6-757d-4c69-a947-98b73f488612 req-168818c5-6cc0-4364-8e00-58a408ddf0a1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:14.575281 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-f977cca6-757d-4c69-a947-98b73f488612 req-168818c5-6cc0-4364-8e00-58a408ddf0a1 service nova] Creating event network-vif-plugged:c39795df-aa38-41cd-a915-613253053131 for instance 3757ba7d-3058-4402-809d-f211ff48ab91 on hv-cinder-83602 Aug 18 12:29:14.577790 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-f977cca6-757d-4c69-a947-98b73f488612 req-168818c5-6cc0-4364-8e00-58a408ddf0a1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046343 Aug 18 12:29:14.578377 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 436/861] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:29:14.930754 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-2aebc547-aeb8-4923-8823-fa21f9b12630 req-2151971b-2af2-4a4e-a281-950d9d930de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3d0863-3d23-4709-83a9-12686e8b3e7d", "tag": "1995adb2-e636-4547-963d-8b7702c12099"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:14.941417 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-2aebc547-aeb8-4923-8823-fa21f9b12630 req-2151971b-2af2-4a4e-a281-950d9d930de2 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:14.941819 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-2aebc547-aeb8-4923-8823-fa21f9b12630 req-2151971b-2af2-4a4e-a281-950d9d930de2 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:14.942250 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-2aebc547-aeb8-4923-8823-fa21f9b12630 req-2151971b-2af2-4a4e-a281-950d9d930de2 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:14.953911 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-2aebc547-aeb8-4923-8823-fa21f9b12630 req-2151971b-2af2-4a4e-a281-950d9d930de2 service nova] Creating event network-changed:1995adb2-e636-4547-963d-8b7702c12099 for instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d on hv-cinder-83602 Aug 18 12:29:14.959001 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-2aebc547-aeb8-4923-8823-fa21f9b12630 req-2151971b-2af2-4a4e-a281-950d9d930de2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032140 Aug 18 12:29:14.959787 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 426/862] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:29:15.217842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-94b7a3d2-7ba1-481e-b997-a7148cec9a37 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:15.218611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-94b7a3d2-7ba1-481e-b997-a7148cec9a37 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:15.225623 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-94b7a3d2-7ba1-481e-b997-a7148cec9a37 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:15.226101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-94b7a3d2-7ba1-481e-b997-a7148cec9a37 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:15.226531 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-94b7a3d2-7ba1-481e-b997-a7148cec9a37 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:15.227223 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-94b7a3d2-7ba1-481e-b997-a7148cec9a37 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:15.227702 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-94b7a3d2-7ba1-481e-b997-a7148cec9a37 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:15.228124 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-94b7a3d2-7ba1-481e-b997-a7148cec9a37 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:15.392776 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-94b7a3d2-7ba1-481e-b997-a7148cec9a37 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:15.400313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-94b7a3d2-7ba1-481e-b997-a7148cec9a37 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1266 microversion: 2.1 time: 0.187202 Aug 18 12:29:15.400872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 437/863] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:15 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:15.574637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-16f12419-b196-4084-8fa8-d08ccb8dae09 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:15.575337 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-16f12419-b196-4084-8fa8-d08ccb8dae09 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:15.582244 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16f12419-b196-4084-8fa8-d08ccb8dae09 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:15.582730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16f12419-b196-4084-8fa8-d08ccb8dae09 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:15.583174 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16f12419-b196-4084-8fa8-d08ccb8dae09 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:15.583900 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16f12419-b196-4084-8fa8-d08ccb8dae09 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:15.584353 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16f12419-b196-4084-8fa8-d08ccb8dae09 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:15.584789 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-16f12419-b196-4084-8fa8-d08ccb8dae09 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:15.692905 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:15.715550 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=6 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:15.721246 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-16f12419-b196-4084-8fa8-d08ccb8dae09 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:15.729216 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-16f12419-b196-4084-8fa8-d08ccb8dae09 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1366 microversion: 2.1 time: 0.159305 Aug 18 12:29:15.729781 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 427/864] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:15 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:16.421626 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-84200a7f-dcc1-4f67-b967-c0cc236315c7 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:16.422162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-84200a7f-dcc1-4f67-b967-c0cc236315c7 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:16.428862 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84200a7f-dcc1-4f67-b967-c0cc236315c7 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.429345 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84200a7f-dcc1-4f67-b967-c0cc236315c7 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.429779 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84200a7f-dcc1-4f67-b967-c0cc236315c7 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:16.430466 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84200a7f-dcc1-4f67-b967-c0cc236315c7 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.430916 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84200a7f-dcc1-4f67-b967-c0cc236315c7 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.431336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84200a7f-dcc1-4f67-b967-c0cc236315c7 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:16.750007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ab627967-da7f-4701-9598-ae5437fa24ff tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:16.750567 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ab627967-da7f-4701-9598-ae5437fa24ff tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:16.758215 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab627967-da7f-4701-9598-ae5437fa24ff tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.758789 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab627967-da7f-4701-9598-ae5437fa24ff tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.759135 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab627967-da7f-4701-9598-ae5437fa24ff tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:16.759881 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab627967-da7f-4701-9598-ae5437fa24ff tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.760335 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab627967-da7f-4701-9598-ae5437fa24ff tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.760755 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab627967-da7f-4701-9598-ae5437fa24ff tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:16.904291 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ab627967-da7f-4701-9598-ae5437fa24ff tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:16.912313 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ab627967-da7f-4701-9598-ae5437fa24ff tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1556 microversion: 2.1 time: 0.166700 Aug 18 12:29:16.912880 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 428/865] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:16 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:16.931368 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-84200a7f-dcc1-4f67-b967-c0cc236315c7 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:16.936380 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-df32c6b7-3eb1-456b-862d-2c3015292353 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:16.937110 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-df32c6b7-3eb1-456b-862d-2c3015292353 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:16.939118 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-84200a7f-dcc1-4f67-b967-c0cc236315c7 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1266 microversion: 2.1 time: 0.521278 Aug 18 12:29:16.943270 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 438/866] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:16 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1266 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:16.944065 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-df32c6b7-3eb1-456b-862d-2c3015292353 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.944668 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-df32c6b7-3eb1-456b-862d-2c3015292353 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.945168 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-df32c6b7-3eb1-456b-862d-2c3015292353 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:16.946068 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-df32c6b7-3eb1-456b-862d-2c3015292353 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.946511 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-df32c6b7-3eb1-456b-862d-2c3015292353 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.947024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-df32c6b7-3eb1-456b-862d-2c3015292353 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:17.028903 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-df32c6b7-3eb1-456b-862d-2c3015292353 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097337 Aug 18 12:29:17.029498 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 429/867] 10.222.0.98 () {58 vars in 1275 bytes} [Thu Aug 18 12:29:16 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:29:17.962063 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7530c15c-50f3-482d-a469-e5e2f1d219e6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:17.962684 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7530c15c-50f3-482d-a469-e5e2f1d219e6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:17.969260 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7530c15c-50f3-482d-a469-e5e2f1d219e6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:17.969752 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7530c15c-50f3-482d-a469-e5e2f1d219e6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:17.970185 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7530c15c-50f3-482d-a469-e5e2f1d219e6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:17.971525 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7530c15c-50f3-482d-a469-e5e2f1d219e6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:17.971981 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7530c15c-50f3-482d-a469-e5e2f1d219e6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:17.972409 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7530c15c-50f3-482d-a469-e5e2f1d219e6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:18.084940 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-cb0e788a-0985-48d1-a4b5-fc046efc8a60 req-caeb7b44-d0ac-4ae3-a07d-1e5b21ba12ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3757ba7d-3058-4402-809d-f211ff48ab91", "tag": "c39795df-aa38-41cd-a915-613253053131"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:18.096361 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-cb0e788a-0985-48d1-a4b5-fc046efc8a60 req-caeb7b44-d0ac-4ae3-a07d-1e5b21ba12ad service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:18.096849 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-cb0e788a-0985-48d1-a4b5-fc046efc8a60 req-caeb7b44-d0ac-4ae3-a07d-1e5b21ba12ad service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:18.097285 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-cb0e788a-0985-48d1-a4b5-fc046efc8a60 req-caeb7b44-d0ac-4ae3-a07d-1e5b21ba12ad service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:18.110798 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-cb0e788a-0985-48d1-a4b5-fc046efc8a60 req-caeb7b44-d0ac-4ae3-a07d-1e5b21ba12ad service nova] Creating event network-changed:c39795df-aa38-41cd-a915-613253053131 for instance 3757ba7d-3058-4402-809d-f211ff48ab91 on hv-cinder-83602 Aug 18 12:29:18.116763 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-cb0e788a-0985-48d1-a4b5-fc046efc8a60 req-caeb7b44-d0ac-4ae3-a07d-1e5b21ba12ad service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037271 Aug 18 12:29:18.117888 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 430/868] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:29:18.122949 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7530c15c-50f3-482d-a469-e5e2f1d219e6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:18.131314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7530c15c-50f3-482d-a469-e5e2f1d219e6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1266 microversion: 2.1 time: 0.173119 Aug 18 12:29:18.132447 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 439/869] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:17 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:19.153849 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3edb56ff-9ae2-4298-9da5-30aad567266e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:19.154533 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3edb56ff-9ae2-4298-9da5-30aad567266e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:19.161288 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3edb56ff-9ae2-4298-9da5-30aad567266e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:19.161762 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3edb56ff-9ae2-4298-9da5-30aad567266e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:19.162188 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3edb56ff-9ae2-4298-9da5-30aad567266e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:19.162868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3edb56ff-9ae2-4298-9da5-30aad567266e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:19.163311 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3edb56ff-9ae2-4298-9da5-30aad567266e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:19.163756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3edb56ff-9ae2-4298-9da5-30aad567266e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:19.301898 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3edb56ff-9ae2-4298-9da5-30aad567266e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:19.309511 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3edb56ff-9ae2-4298-9da5-30aad567266e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1266 microversion: 2.1 time: 0.160308 Aug 18 12:29:19.310077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 431/870] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:19 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:20.330376 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-11076e0c-2928-488a-9200-3bac90f1cb11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:20.330913 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-11076e0c-2928-488a-9200-3bac90f1cb11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:20.332888 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:20.337715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-11076e0c-2928-488a-9200-3bac90f1cb11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:20.338193 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-11076e0c-2928-488a-9200-3bac90f1cb11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:20.338622 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-11076e0c-2928-488a-9200-3bac90f1cb11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:20.339312 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-11076e0c-2928-488a-9200-3bac90f1cb11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:20.342275 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-11076e0c-2928-488a-9200-3bac90f1cb11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:20.342275 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-11076e0c-2928-488a-9200-3bac90f1cb11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:20.473502 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-11076e0c-2928-488a-9200-3bac90f1cb11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:20.481272 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-11076e0c-2928-488a-9200-3bac90f1cb11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1266 microversion: 2.1 time: 0.155014 Aug 18 12:29:20.481928 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 440/871] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:20 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:21.502083 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-858398ae-0ce2-4d42-9f60-951e16f644fa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:21.502686 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-858398ae-0ce2-4d42-9f60-951e16f644fa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:21.509155 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-858398ae-0ce2-4d42-9f60-951e16f644fa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:21.509637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-858398ae-0ce2-4d42-9f60-951e16f644fa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:21.510074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-858398ae-0ce2-4d42-9f60-951e16f644fa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:21.510766 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-858398ae-0ce2-4d42-9f60-951e16f644fa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:21.511299 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-858398ae-0ce2-4d42-9f60-951e16f644fa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:21.511757 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-858398ae-0ce2-4d42-9f60-951e16f644fa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:21.640552 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-858398ae-0ce2-4d42-9f60-951e16f644fa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:21.648830 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-858398ae-0ce2-4d42-9f60-951e16f644fa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1266 microversion: 2.1 time: 0.150633 Aug 18 12:29:21.649387 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 432/872] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:21 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:22.669847 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4ac472a3-9c67-4f66-a02e-ae8369853e54 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:22.670682 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-4ac472a3-9c67-4f66-a02e-ae8369853e54 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:22.672690 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=14 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:22.678774 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ac472a3-9c67-4f66-a02e-ae8369853e54 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:22.679253 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ac472a3-9c67-4f66-a02e-ae8369853e54 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:22.682085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ac472a3-9c67-4f66-a02e-ae8369853e54 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:22.682085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ac472a3-9c67-4f66-a02e-ae8369853e54 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:22.682085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ac472a3-9c67-4f66-a02e-ae8369853e54 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:22.682085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ac472a3-9c67-4f66-a02e-ae8369853e54 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:22.824369 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-4ac472a3-9c67-4f66-a02e-ae8369853e54 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:22.831791 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4ac472a3-9c67-4f66-a02e-ae8369853e54 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1266 microversion: 2.1 time: 0.165891 Aug 18 12:29:22.832344 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 441/873] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:22 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:23.852539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5d80b731-d7ea-4e18-baf9-c73b8c9af0f8 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:23.853153 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5d80b731-d7ea-4e18-baf9-c73b8c9af0f8 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:23.859854 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5d80b731-d7ea-4e18-baf9-c73b8c9af0f8 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:23.860341 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5d80b731-d7ea-4e18-baf9-c73b8c9af0f8 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:23.861290 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5d80b731-d7ea-4e18-baf9-c73b8c9af0f8 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:23.861995 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5d80b731-d7ea-4e18-baf9-c73b8c9af0f8 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:23.862448 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5d80b731-d7ea-4e18-baf9-c73b8c9af0f8 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:23.862875 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5d80b731-d7ea-4e18-baf9-c73b8c9af0f8 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:23.995308 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5d80b731-d7ea-4e18-baf9-c73b8c9af0f8 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:24.003601 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5d80b731-d7ea-4e18-baf9-c73b8c9af0f8 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1266 microversion: 2.1 time: 0.155320 Aug 18 12:29:24.008980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 433/874] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:23 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:25.024176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3fe2289b-20ce-4130-9473-4c63b35f3a78 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:25.024817 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3fe2289b-20ce-4130-9473-4c63b35f3a78 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:25.031554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3fe2289b-20ce-4130-9473-4c63b35f3a78 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:25.032042 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3fe2289b-20ce-4130-9473-4c63b35f3a78 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:25.032479 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3fe2289b-20ce-4130-9473-4c63b35f3a78 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:25.033206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3fe2289b-20ce-4130-9473-4c63b35f3a78 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:25.033657 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3fe2289b-20ce-4130-9473-4c63b35f3a78 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:25.034080 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3fe2289b-20ce-4130-9473-4c63b35f3a78 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:25.169412 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3fe2289b-20ce-4130-9473-4c63b35f3a78 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:25.185123 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3fe2289b-20ce-4130-9473-4c63b35f3a78 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1266 microversion: 2.1 time: 0.164719 Aug 18 12:29:25.185703 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 442/875] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:25 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:26.206155 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a9ec04ba-51ca-48d8-bd31-cacadbb2fcbb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:26.206786 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a9ec04ba-51ca-48d8-bd31-cacadbb2fcbb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:26.212907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9ec04ba-51ca-48d8-bd31-cacadbb2fcbb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:26.213393 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9ec04ba-51ca-48d8-bd31-cacadbb2fcbb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:26.213828 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9ec04ba-51ca-48d8-bd31-cacadbb2fcbb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:26.214520 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9ec04ba-51ca-48d8-bd31-cacadbb2fcbb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:26.214979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9ec04ba-51ca-48d8-bd31-cacadbb2fcbb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:26.215408 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a9ec04ba-51ca-48d8-bd31-cacadbb2fcbb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:26.346707 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a9ec04ba-51ca-48d8-bd31-cacadbb2fcbb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:26.354935 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a9ec04ba-51ca-48d8-bd31-cacadbb2fcbb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1266 microversion: 2.1 time: 0.152882 Aug 18 12:29:26.355530 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 434/876] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:26 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:26.608798 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-b1cad2d2-9eb3-43f6-b077-441bc2dfe37e req-7264f885-b588-4c11-ac55-5511d76d91b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3d0863-3d23-4709-83a9-12686e8b3e7d", "name": "network-vif-plugged", "status": "completed", "tag": "1995adb2-e636-4547-963d-8b7702c12099"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:26.618587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-b1cad2d2-9eb3-43f6-b077-441bc2dfe37e req-7264f885-b588-4c11-ac55-5511d76d91b2 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:26.619065 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-b1cad2d2-9eb3-43f6-b077-441bc2dfe37e req-7264f885-b588-4c11-ac55-5511d76d91b2 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:26.621596 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-b1cad2d2-9eb3-43f6-b077-441bc2dfe37e req-7264f885-b588-4c11-ac55-5511d76d91b2 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:26.630633 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-b1cad2d2-9eb3-43f6-b077-441bc2dfe37e req-7264f885-b588-4c11-ac55-5511d76d91b2 service nova] Creating event network-vif-plugged:1995adb2-e636-4547-963d-8b7702c12099 for instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d on hv-cinder-83602 Aug 18 12:29:26.635549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-b1cad2d2-9eb3-43f6-b077-441bc2dfe37e req-7264f885-b588-4c11-ac55-5511d76d91b2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030518 Aug 18 12:29:26.636127 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 443/877] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:29:27.376557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3504f64f-91c3-4cba-a7f7-15643d7f0f0d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:27.377120 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3504f64f-91c3-4cba-a7f7-15643d7f0f0d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:27.383867 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3504f64f-91c3-4cba-a7f7-15643d7f0f0d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:27.384352 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3504f64f-91c3-4cba-a7f7-15643d7f0f0d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:27.384790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3504f64f-91c3-4cba-a7f7-15643d7f0f0d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:27.386229 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3504f64f-91c3-4cba-a7f7-15643d7f0f0d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:27.386694 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3504f64f-91c3-4cba-a7f7-15643d7f0f0d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:27.387121 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3504f64f-91c3-4cba-a7f7-15643d7f0f0d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:27.521325 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3504f64f-91c3-4cba-a7f7-15643d7f0f0d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:27.528728 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3504f64f-91c3-4cba-a7f7-15643d7f0f0d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1266 microversion: 2.1 time: 0.157008 Aug 18 12:29:27.529286 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 435/878] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:27 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:28.550945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-59b73c3d-3721-4a4c-b91b-51576f423259 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:28.551685 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-59b73c3d-3721-4a4c-b91b-51576f423259 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:28.557799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-59b73c3d-3721-4a4c-b91b-51576f423259 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:28.558269 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-59b73c3d-3721-4a4c-b91b-51576f423259 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:28.558698 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-59b73c3d-3721-4a4c-b91b-51576f423259 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:28.559384 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-59b73c3d-3721-4a4c-b91b-51576f423259 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:28.559848 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-59b73c3d-3721-4a4c-b91b-51576f423259 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:28.560266 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-59b73c3d-3721-4a4c-b91b-51576f423259 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:28.694801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-59b73c3d-3721-4a4c-b91b-51576f423259 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:28.702702 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-59b73c3d-3721-4a4c-b91b-51576f423259 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1453 microversion: 2.1 time: 0.157110 Aug 18 12:29:28.703268 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 444/879] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:28 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:28.723052 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-69dfd423-8efe-4c39-a45f-9af324bdb1ab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:28.723881 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-69dfd423-8efe-4c39-a45f-9af324bdb1ab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:28.730257 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69dfd423-8efe-4c39-a45f-9af324bdb1ab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:28.730732 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69dfd423-8efe-4c39-a45f-9af324bdb1ab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:28.731164 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69dfd423-8efe-4c39-a45f-9af324bdb1ab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:28.731872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69dfd423-8efe-4c39-a45f-9af324bdb1ab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:28.732318 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69dfd423-8efe-4c39-a45f-9af324bdb1ab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:28.732737 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-69dfd423-8efe-4c39-a45f-9af324bdb1ab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:28.868710 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-69dfd423-8efe-4c39-a45f-9af324bdb1ab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:28.876365 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-69dfd423-8efe-4c39-a45f-9af324bdb1ab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1453 microversion: 2.1 time: 0.157813 Aug 18 12:29:28.876926 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 436/880] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:28 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:31.190684 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-15fcb278-c573-461b-b868-6bf5a531c5a2 req-f5b32d81-c01d-4b0b-acc1-b51530dc8705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3d0863-3d23-4709-83a9-12686e8b3e7d", "tag": "1995adb2-e636-4547-963d-8b7702c12099"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:31.200482 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-15fcb278-c573-461b-b868-6bf5a531c5a2 req-f5b32d81-c01d-4b0b-acc1-b51530dc8705 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:31.200953 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-15fcb278-c573-461b-b868-6bf5a531c5a2 req-f5b32d81-c01d-4b0b-acc1-b51530dc8705 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:31.201398 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-15fcb278-c573-461b-b868-6bf5a531c5a2 req-f5b32d81-c01d-4b0b-acc1-b51530dc8705 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:31.216676 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-15fcb278-c573-461b-b868-6bf5a531c5a2 req-f5b32d81-c01d-4b0b-acc1-b51530dc8705 service nova] Creating event network-changed:1995adb2-e636-4547-963d-8b7702c12099 for instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d on hv-cinder-83602 Aug 18 12:29:31.221868 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-15fcb278-c573-461b-b868-6bf5a531c5a2 req-f5b32d81-c01d-4b0b-acc1-b51530dc8705 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035547 Aug 18 12:29:31.222478 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 445/881] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:29:54.002057 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c2ba8a81-bcc0-42f0-88f0-0e732cbcf16e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:54.002637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c2ba8a81-bcc0-42f0-88f0-0e732cbcf16e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:54.005400 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:54.006104 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=96 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:54.010811 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2ba8a81-bcc0-42f0-88f0-0e732cbcf16e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:54.012237 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2ba8a81-bcc0-42f0-88f0-0e732cbcf16e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:54.012237 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2ba8a81-bcc0-42f0-88f0-0e732cbcf16e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:54.012468 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2ba8a81-bcc0-42f0-88f0-0e732cbcf16e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:54.012922 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2ba8a81-bcc0-42f0-88f0-0e732cbcf16e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:54.013357 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2ba8a81-bcc0-42f0-88f0-0e732cbcf16e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:54.037693 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c2ba8a81-bcc0-42f0-88f0-0e732cbcf16e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/ips" status: 200 len: 150 microversion: 2.1 time: 0.039516 Aug 18 12:29:54.046744 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 437/882] 10.222.0.98 () {58 vars in 1248 bytes} [Thu Aug 18 12:29:53 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:29:55.774644 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:55.775401 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=74 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:55.779881 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a65107d0-e39b-4bf9-ac8a-41ae3d6b8120 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b183fd08-e1ff-47a4-a80c-64989929b709"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:55.782278 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a65107d0-e39b-4bf9-ac8a-41ae3d6b8120 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:55.788846 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a65107d0-e39b-4bf9-ac8a-41ae3d6b8120 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:55.789655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a65107d0-e39b-4bf9-ac8a-41ae3d6b8120 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:55.789896 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a65107d0-e39b-4bf9-ac8a-41ae3d6b8120 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:55.790623 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a65107d0-e39b-4bf9-ac8a-41ae3d6b8120 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:55.791111 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a65107d0-e39b-4bf9-ac8a-41ae3d6b8120 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:55.791568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a65107d0-e39b-4bf9-ac8a-41ae3d6b8120 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:56.510998 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a65107d0-e39b-4bf9-ac8a-41ae3d6b8120 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737634 Aug 18 12:29:56.511641 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 446/883] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:29:55 2022] POST /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:30:04.029066 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-58a3f034-58b6-4bce-8b4a-0c2dc3eabf91 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: .version_select at 0x7f3787ea3c10>, body: {"keypair": {"name": "tempest-keypair-1015074496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnWM2Qs1pjyyXqzEi38010kfCNI+tG/tCFhuCgZqKxdO0Q+vsVN1WAYZugGt7+pWP6pS+ASnLxd7NGSybm3UAva73ejnBXxH73XPvXN1nXruYJz8pVoeJVnwQHyOva8oA=="}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:04.045255 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-58a3f034-58b6-4bce-8b4a-0c2dc3eabf91 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:30:04.049128 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-58a3f034-58b6-4bce-8b4a-0c2dc3eabf91 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for user 27ed3f0ca7c44672a42aa774b02de88c and project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:30:04.152934 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-58a3f034-58b6-4bce-8b4a-0c2dc3eabf91 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127795 Aug 18 12:30:04.153540 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 438/884] 10.222.0.98 () {60 vars in 1159 bytes} [Thu Aug 18 12:30:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:30:06.256471 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1896638689", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e16b12d6-9788-4022-91a7-d06421bd0ecc"}], "security_groups": [{"name": "tempest-securitygroup--562983586"}], "key_name": "tempest-keypair-1015074496", "user_data": "}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:06.264986 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:06.361872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.network.neutron [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] validate_networks() for [('e16b12d6-9788-4022-91a7-d06421bd0ecc', None, None, None, None, None)] {{(pid=121245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:30:06.428128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:06.740725 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Flavor limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:30:06.741149 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Image limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:30:06.741621 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Flavor pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:30:06.742032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Image pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:30:06.742443 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:30:06.751339 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:06.751843 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:06.752275 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:06.752999 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:06.753449 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:06.753872 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:06.771013 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:30:06.774963 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for user 27ed3f0ca7c44672a42aa774b02de88c and project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:30:06.786554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Going to run 1 instances... {{(pid=121245) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:30:06.788974 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:30:06.907697 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-d91fcef5-4e39-44a9-8196-8cdeaa909941 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.656270 Aug 18 12:30:06.908354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 447/885] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:30:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:30:06.920284 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f2fe1407-8a4e-4f36-885e-ba85ae754d76 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:06.920906 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f2fe1407-8a4e-4f36-885e-ba85ae754d76 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:06.984617 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f2fe1407-8a4e-4f36-885e-ba85ae754d76 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:06.993316 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f2fe1407-8a4e-4f36-885e-ba85ae754d76 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1242 microversion: 2.1 time: 0.077546 Aug 18 12:30:06.993879 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 439/886] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:06 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:08.015788 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-85f00458-d640-4959-8b71-a3fdf89d924d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:08.016466 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-85f00458-d640-4959-8b71-a3fdf89d924d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:08.025283 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85f00458-d640-4959-8b71-a3fdf89d924d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:08.025783 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85f00458-d640-4959-8b71-a3fdf89d924d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:08.026222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85f00458-d640-4959-8b71-a3fdf89d924d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:08.026928 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85f00458-d640-4959-8b71-a3fdf89d924d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:08.027382 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85f00458-d640-4959-8b71-a3fdf89d924d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:08.027914 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-85f00458-d640-4959-8b71-a3fdf89d924d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:08.094707 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-85f00458-d640-4959-8b71-a3fdf89d924d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:08.103138 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-85f00458-d640-4959-8b71-a3fdf89d924d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1238 microversion: 2.1 time: 0.091497 Aug 18 12:30:08.103703 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 448/887] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:08 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:09.124242 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2cc59793-29f4-4875-a7bc-735d7fced872 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:09.124855 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2cc59793-29f4-4875-a7bc-735d7fced872 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:09.132985 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc59793-29f4-4875-a7bc-735d7fced872 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:09.132985 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc59793-29f4-4875-a7bc-735d7fced872 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:09.133536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc59793-29f4-4875-a7bc-735d7fced872 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:09.134093 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc59793-29f4-4875-a7bc-735d7fced872 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:09.134541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc59793-29f4-4875-a7bc-735d7fced872 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:09.134960 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2cc59793-29f4-4875-a7bc-735d7fced872 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:09.204435 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2cc59793-29f4-4875-a7bc-735d7fced872 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:09.212083 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2cc59793-29f4-4875-a7bc-735d7fced872 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1300 microversion: 2.1 time: 0.091745 Aug 18 12:30:09.212659 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 440/888] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:09 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:10.233641 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1740f64b-4c2b-4612-82bf-750e53e2d8cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:10.234261 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1740f64b-4c2b-4612-82bf-750e53e2d8cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:10.242093 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1740f64b-4c2b-4612-82bf-750e53e2d8cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:10.242580 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1740f64b-4c2b-4612-82bf-750e53e2d8cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:10.243015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1740f64b-4c2b-4612-82bf-750e53e2d8cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:10.243750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1740f64b-4c2b-4612-82bf-750e53e2d8cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:10.244203 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1740f64b-4c2b-4612-82bf-750e53e2d8cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:10.244677 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1740f64b-4c2b-4612-82bf-750e53e2d8cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:10.377507 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1740f64b-4c2b-4612-82bf-750e53e2d8cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:10.385206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1740f64b-4c2b-4612-82bf-750e53e2d8cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1367 microversion: 2.1 time: 0.155527 Aug 18 12:30:10.385857 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 449/889] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:10 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:10.513286 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-a41c22f5-c2d2-478d-a75f-360842e4ad34 req-f2051561-cd5e-42fc-a4b8-b1e1ff89e77c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dffa315-14de-447c-9091-a2ebc33584f8", "tag": "11642d84-bc85-4e9b-976f-eaade1a13937"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:10.520786 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-a41c22f5-c2d2-478d-a75f-360842e4ad34 req-f2051561-cd5e-42fc-a4b8-b1e1ff89e77c service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:10.521298 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-a41c22f5-c2d2-478d-a75f-360842e4ad34 req-f2051561-cd5e-42fc-a4b8-b1e1ff89e77c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:10.521731 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-a41c22f5-c2d2-478d-a75f-360842e4ad34 req-f2051561-cd5e-42fc-a4b8-b1e1ff89e77c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:10.532715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-a41c22f5-c2d2-478d-a75f-360842e4ad34 req-f2051561-cd5e-42fc-a4b8-b1e1ff89e77c service nova] Creating event network-changed:11642d84-bc85-4e9b-976f-eaade1a13937 for instance 9dffa315-14de-447c-9091-a2ebc33584f8 on hv-cinder-83602 Aug 18 12:30:10.537797 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-a41c22f5-c2d2-478d-a75f-360842e4ad34 req-f2051561-cd5e-42fc-a4b8-b1e1ff89e77c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031824 Aug 18 12:30:10.538448 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 441/890] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:30:11.406354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c717f0da-1eb4-4308-8cf6-62df03168312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:11.406964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c717f0da-1eb4-4308-8cf6-62df03168312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:11.414239 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c717f0da-1eb4-4308-8cf6-62df03168312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:11.414718 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c717f0da-1eb4-4308-8cf6-62df03168312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:11.415148 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c717f0da-1eb4-4308-8cf6-62df03168312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:11.415924 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c717f0da-1eb4-4308-8cf6-62df03168312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:11.416360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c717f0da-1eb4-4308-8cf6-62df03168312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:11.416781 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c717f0da-1eb4-4308-8cf6-62df03168312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:11.544082 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c717f0da-1eb4-4308-8cf6-62df03168312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:11.551647 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c717f0da-1eb4-4308-8cf6-62df03168312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1367 microversion: 2.1 time: 0.149321 Aug 18 12:30:11.552322 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 450/891] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:11 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:12.573355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ad45ed3e-ffc2-4caa-8052-b6ce96e07bf3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:12.573968 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ad45ed3e-ffc2-4caa-8052-b6ce96e07bf3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:12.580530 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad45ed3e-ffc2-4caa-8052-b6ce96e07bf3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:12.581009 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad45ed3e-ffc2-4caa-8052-b6ce96e07bf3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:12.581440 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad45ed3e-ffc2-4caa-8052-b6ce96e07bf3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:12.582132 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad45ed3e-ffc2-4caa-8052-b6ce96e07bf3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:12.582583 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad45ed3e-ffc2-4caa-8052-b6ce96e07bf3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:12.583001 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad45ed3e-ffc2-4caa-8052-b6ce96e07bf3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:12.719239 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ad45ed3e-ffc2-4caa-8052-b6ce96e07bf3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:12.727898 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ad45ed3e-ffc2-4caa-8052-b6ce96e07bf3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1367 microversion: 2.1 time: 0.159235 Aug 18 12:30:12.728470 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 442/892] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:12 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:13.748680 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8727e6e5-b9c0-4e30-ab79-4f1683bb6056 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:13.749282 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8727e6e5-b9c0-4e30-ab79-4f1683bb6056 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:13.756943 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8727e6e5-b9c0-4e30-ab79-4f1683bb6056 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:13.757417 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8727e6e5-b9c0-4e30-ab79-4f1683bb6056 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:13.757840 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8727e6e5-b9c0-4e30-ab79-4f1683bb6056 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:13.758516 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8727e6e5-b9c0-4e30-ab79-4f1683bb6056 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:13.758957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8727e6e5-b9c0-4e30-ab79-4f1683bb6056 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:13.759372 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8727e6e5-b9c0-4e30-ab79-4f1683bb6056 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:13.891130 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8727e6e5-b9c0-4e30-ab79-4f1683bb6056 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:13.899185 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8727e6e5-b9c0-4e30-ab79-4f1683bb6056 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1367 microversion: 2.1 time: 0.154321 Aug 18 12:30:13.899783 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 451/893] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:13 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:14.892933 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-78b25a1f-4948-43a6-9d76-4488dcacaa78 req-5126f1f1-1a5c-4b4f-a8e1-dd6e33bbddd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dffa315-14de-447c-9091-a2ebc33584f8", "name": "network-vif-plugged", "status": "completed", "tag": "11642d84-bc85-4e9b-976f-eaade1a13937"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:14.903253 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-78b25a1f-4948-43a6-9d76-4488dcacaa78 req-5126f1f1-1a5c-4b4f-a8e1-dd6e33bbddd9 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:14.903755 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-78b25a1f-4948-43a6-9d76-4488dcacaa78 req-5126f1f1-1a5c-4b4f-a8e1-dd6e33bbddd9 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:14.904830 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-78b25a1f-4948-43a6-9d76-4488dcacaa78 req-5126f1f1-1a5c-4b4f-a8e1-dd6e33bbddd9 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:14.915524 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-78b25a1f-4948-43a6-9d76-4488dcacaa78 req-5126f1f1-1a5c-4b4f-a8e1-dd6e33bbddd9 service nova] Creating event network-vif-plugged:11642d84-bc85-4e9b-976f-eaade1a13937 for instance 9dffa315-14de-447c-9091-a2ebc33584f8 on hv-cinder-83602 Aug 18 12:30:14.919802 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ec52cc5d-955b-4d11-8628-b46433e968b9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:14.920418 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ec52cc5d-955b-4d11-8628-b46433e968b9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:14.920563 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-78b25a1f-4948-43a6-9d76-4488dcacaa78 req-5126f1f1-1a5c-4b4f-a8e1-dd6e33bbddd9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031338 Aug 18 12:30:14.921105 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 443/894] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:30:14.927184 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec52cc5d-955b-4d11-8628-b46433e968b9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:14.928421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec52cc5d-955b-4d11-8628-b46433e968b9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:14.928865 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec52cc5d-955b-4d11-8628-b46433e968b9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:14.929579 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec52cc5d-955b-4d11-8628-b46433e968b9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:14.930037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec52cc5d-955b-4d11-8628-b46433e968b9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:14.930463 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ec52cc5d-955b-4d11-8628-b46433e968b9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:15.065312 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ec52cc5d-955b-4d11-8628-b46433e968b9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:15.073707 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ec52cc5d-955b-4d11-8628-b46433e968b9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1367 microversion: 2.1 time: 0.157854 Aug 18 12:30:15.074331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 452/895] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:14 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:16.094634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e45313c8-40c3-4509-b145-c9bb20285cea tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:16.095326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e45313c8-40c3-4509-b145-c9bb20285cea tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:16.102270 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e45313c8-40c3-4509-b145-c9bb20285cea tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:16.102748 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e45313c8-40c3-4509-b145-c9bb20285cea tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:16.103181 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e45313c8-40c3-4509-b145-c9bb20285cea tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:16.103917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e45313c8-40c3-4509-b145-c9bb20285cea tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:16.104365 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e45313c8-40c3-4509-b145-c9bb20285cea tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:16.104789 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e45313c8-40c3-4509-b145-c9bb20285cea tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:16.238235 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e45313c8-40c3-4509-b145-c9bb20285cea tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:16.246357 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e45313c8-40c3-4509-b145-c9bb20285cea tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1367 microversion: 2.1 time: 0.155857 Aug 18 12:30:16.247583 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 444/896] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:16 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:17.267950 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-25cb99f5-a5c9-4212-9bb0-f008475c42a5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:17.268568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-25cb99f5-a5c9-4212-9bb0-f008475c42a5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:17.270907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:17.272091 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=6 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:17.276935 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-25cb99f5-a5c9-4212-9bb0-f008475c42a5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:17.277411 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-25cb99f5-a5c9-4212-9bb0-f008475c42a5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:17.277844 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-25cb99f5-a5c9-4212-9bb0-f008475c42a5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:17.278530 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-25cb99f5-a5c9-4212-9bb0-f008475c42a5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:17.278977 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-25cb99f5-a5c9-4212-9bb0-f008475c42a5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:17.279395 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-25cb99f5-a5c9-4212-9bb0-f008475c42a5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:17.423936 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-25cb99f5-a5c9-4212-9bb0-f008475c42a5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:17.431554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-25cb99f5-a5c9-4212-9bb0-f008475c42a5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1557 microversion: 2.1 time: 0.167432 Aug 18 12:30:17.432139 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 453/897] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:17 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:17.451355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-482c2fb0-d8b5-490e-a977-37e281fe2e57 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:17.451902 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-482c2fb0-d8b5-490e-a977-37e281fe2e57 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:17.453864 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=6 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:17.459728 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-482c2fb0-d8b5-490e-a977-37e281fe2e57 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:17.460211 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-482c2fb0-d8b5-490e-a977-37e281fe2e57 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:17.460739 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-482c2fb0-d8b5-490e-a977-37e281fe2e57 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:17.461393 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-482c2fb0-d8b5-490e-a977-37e281fe2e57 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:17.461847 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-482c2fb0-d8b5-490e-a977-37e281fe2e57 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:17.462272 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-482c2fb0-d8b5-490e-a977-37e281fe2e57 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:17.539757 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-482c2fb0-d8b5-490e-a977-37e281fe2e57 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092353 Aug 18 12:30:17.540363 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 445/898] 10.222.0.98 () {58 vars in 1275 bytes} [Thu Aug 18 12:30:17 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:30:18.839598 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-a9ded4a2-de59-441c-9152-a425249493fe req-f53dbfba-49cd-43ff-bbb8-aae7cc909d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dffa315-14de-447c-9091-a2ebc33584f8", "tag": "11642d84-bc85-4e9b-976f-eaade1a13937"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:18.850917 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-a9ded4a2-de59-441c-9152-a425249493fe req-f53dbfba-49cd-43ff-bbb8-aae7cc909d93 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:18.851398 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-a9ded4a2-de59-441c-9152-a425249493fe req-f53dbfba-49cd-43ff-bbb8-aae7cc909d93 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:18.851879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-a9ded4a2-de59-441c-9152-a425249493fe req-f53dbfba-49cd-43ff-bbb8-aae7cc909d93 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:18.866486 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-a9ded4a2-de59-441c-9152-a425249493fe req-f53dbfba-49cd-43ff-bbb8-aae7cc909d93 service nova] Creating event network-changed:11642d84-bc85-4e9b-976f-eaade1a13937 for instance 9dffa315-14de-447c-9091-a2ebc33584f8 on hv-cinder-83602 Aug 18 12:30:18.871955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-a9ded4a2-de59-441c-9152-a425249493fe req-f53dbfba-49cd-43ff-bbb8-aae7cc909d93 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036019 Aug 18 12:30:18.872674 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 454/899] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:30:49.272416 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:49.273227 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=30 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:49.277209 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8018e2de-e645-4894-b6b7-2ff9247cc9d5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:49.277737 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8018e2de-e645-4894-b6b7-2ff9247cc9d5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:49.283557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8018e2de-e645-4894-b6b7-2ff9247cc9d5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:49.284875 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8018e2de-e645-4894-b6b7-2ff9247cc9d5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:49.284875 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8018e2de-e645-4894-b6b7-2ff9247cc9d5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:49.285239 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8018e2de-e645-4894-b6b7-2ff9247cc9d5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:49.285571 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8018e2de-e645-4894-b6b7-2ff9247cc9d5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:49.285992 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8018e2de-e645-4894-b6b7-2ff9247cc9d5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:49.309569 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-8018e2de-e645-4894-b6b7-2ff9247cc9d5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lazy-loading 'flavor' on Instance uuid b26fb4ea-80d1-405d-b693-2fe9cbe2f45c {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:30:49.548396 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8018e2de-e645-4894-b6b7-2ff9247cc9d5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "POST /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c/action" status: 202 len: 0 microversion: 2.1 time: 0.277184 Aug 18 12:30:49.548990 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 446/900] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:30:49 2022] POST /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:30:49.557281 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:49.557281 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=40 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:49.561661 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-898eb1cc-b7ec-4ffd-a60c-057966e433d0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:49.562388 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-898eb1cc-b7ec-4ffd-a60c-057966e433d0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:49.568489 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898eb1cc-b7ec-4ffd-a60c-057966e433d0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:49.569008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898eb1cc-b7ec-4ffd-a60c-057966e433d0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:49.569439 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898eb1cc-b7ec-4ffd-a60c-057966e433d0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:49.570125 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898eb1cc-b7ec-4ffd-a60c-057966e433d0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:49.570572 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898eb1cc-b7ec-4ffd-a60c-057966e433d0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:49.570993 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-898eb1cc-b7ec-4ffd-a60c-057966e433d0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:49.758085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-898eb1cc-b7ec-4ffd-a60c-057966e433d0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:49.765549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-898eb1cc-b7ec-4ffd-a60c-057966e433d0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.211287 Aug 18 12:30:49.766097 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 455/901] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:49 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:50.787444 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-045c98c3-271b-49b8-994e-4f7066308dc4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:50.788153 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-045c98c3-271b-49b8-994e-4f7066308dc4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:50.794348 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-045c98c3-271b-49b8-994e-4f7066308dc4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:50.794831 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-045c98c3-271b-49b8-994e-4f7066308dc4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:50.795267 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-045c98c3-271b-49b8-994e-4f7066308dc4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:50.795983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-045c98c3-271b-49b8-994e-4f7066308dc4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:50.796437 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-045c98c3-271b-49b8-994e-4f7066308dc4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:50.796861 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-045c98c3-271b-49b8-994e-4f7066308dc4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:50.986290 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-045c98c3-271b-49b8-994e-4f7066308dc4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:50.993807 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-045c98c3-271b-49b8-994e-4f7066308dc4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.211144 Aug 18 12:30:50.994369 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 447/902] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:50 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:52.014735 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f9aa0b90-74eb-4fc0-a389-2fd2f67adcf4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:52.015344 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f9aa0b90-74eb-4fc0-a389-2fd2f67adcf4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:52.022225 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b90-74eb-4fc0-a389-2fd2f67adcf4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:52.022704 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b90-74eb-4fc0-a389-2fd2f67adcf4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:52.023140 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b90-74eb-4fc0-a389-2fd2f67adcf4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:52.023864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b90-74eb-4fc0-a389-2fd2f67adcf4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:52.024314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b90-74eb-4fc0-a389-2fd2f67adcf4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:52.024734 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b90-74eb-4fc0-a389-2fd2f67adcf4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:52.157113 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f9aa0b90-74eb-4fc0-a389-2fd2f67adcf4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:52.164599 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f9aa0b90-74eb-4fc0-a389-2fd2f67adcf4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.153819 Aug 18 12:30:52.165157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 456/903] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:52 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:53.186539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-2e502a1e-fc68-4c44-8d4e-ce2db4cf9b67 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:53.187150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-2e502a1e-fc68-4c44-8d4e-ce2db4cf9b67 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:53.193636 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2e502a1e-fc68-4c44-8d4e-ce2db4cf9b67 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:53.194113 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2e502a1e-fc68-4c44-8d4e-ce2db4cf9b67 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:53.194546 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2e502a1e-fc68-4c44-8d4e-ce2db4cf9b67 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:53.195229 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2e502a1e-fc68-4c44-8d4e-ce2db4cf9b67 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:53.195770 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2e502a1e-fc68-4c44-8d4e-ce2db4cf9b67 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:53.196197 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-2e502a1e-fc68-4c44-8d4e-ce2db4cf9b67 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:53.334917 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-2e502a1e-fc68-4c44-8d4e-ce2db4cf9b67 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:53.342431 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-2e502a1e-fc68-4c44-8d4e-ce2db4cf9b67 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.160244 Aug 18 12:30:53.342997 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 448/904] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:53 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:54.364357 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8a900b74-55d3-47a1-a76e-9b56136be8b1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:54.368034 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8a900b74-55d3-47a1-a76e-9b56136be8b1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:54.371732 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a900b74-55d3-47a1-a76e-9b56136be8b1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:54.372221 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a900b74-55d3-47a1-a76e-9b56136be8b1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:54.372655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a900b74-55d3-47a1-a76e-9b56136be8b1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:54.373353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a900b74-55d3-47a1-a76e-9b56136be8b1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:54.373808 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a900b74-55d3-47a1-a76e-9b56136be8b1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:54.374236 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a900b74-55d3-47a1-a76e-9b56136be8b1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:54.505244 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-8a900b74-55d3-47a1-a76e-9b56136be8b1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:54.513690 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8a900b74-55d3-47a1-a76e-9b56136be8b1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.153240 Aug 18 12:30:54.514252 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 457/905] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:54 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:55.169798 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-674ec613-4616-4770-8b12-937473597312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:55.170326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-674ec613-4616-4770-8b12-937473597312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:55.176430 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674ec613-4616-4770-8b12-937473597312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:55.176907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674ec613-4616-4770-8b12-937473597312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:55.177336 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674ec613-4616-4770-8b12-937473597312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:55.178022 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674ec613-4616-4770-8b12-937473597312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:55.178467 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674ec613-4616-4770-8b12-937473597312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:55.178894 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-674ec613-4616-4770-8b12-937473597312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:55.202348 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-674ec613-4616-4770-8b12-937473597312 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8/ips" status: 200 len: 150 microversion: 2.1 time: 0.036832 Aug 18 12:30:55.202913 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 449/906] 10.222.0.98 () {58 vars in 1248 bytes} [Thu Aug 18 12:30:55 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:30:55.214259 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b183fd08-e1ff-47a4-a80c-64989929b709"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:55.217129 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:55.223348 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:55.223855 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:55.224280 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:55.224956 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:55.225397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:55.225812 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:55.304553 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Invalid volume: volume b183fd08-e1ff-47a4-a80c-64989929b709 is already attached to instances: 3757ba7d-3058-4402-809d-f211ff48ab91 Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: POST /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8/os-volume_attachments HTTP/1.1 Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 74 Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:30:55.306313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {"volumeAttachment": {"volumeId": "b183fd08-e1ff-47a4-a80c-64989929b709"}} Aug 18 12:30:55.308089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Invalid volume: volume b183fd08-e1ff-47a4-a80c-64989929b709 is already attached to instances: 3757ba7d-3058-4402-809d-f211ff48ab91 Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'server_id': '9dffa315-14de-447c-9091-a2ebc33584f8', 'body': {'volumeAttachment': {'volumeId': 'b183fd08-e1ff-47a4-a80c-64989929b709'}}} Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b183fd08-e1ff-47a4-a80c-64989929b709 is already attached to instances: 3757ba7d-3058-4402-809d-f211ff48ab91 Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:30:55.309255 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b183fd08-e1ff-47a4-a80c-64989929b709 is already attached to instances: 3757ba7d-3058-4402-809d-f211ff48ab91 Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:55.310824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:30:55.313161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:30:55.313161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:30:55.313161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:30:55.313161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b183fd08-e1ff-47a4-a80c-64989929b709 is already attached to instances: 3757ba7d-3058-4402-809d-f211ff48ab91 Aug 18 12:30:55.313161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:30:55.313161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 400 to user: Invalid volume: volume b183fd08-e1ff-47a4-a80c-64989929b709 is already attached to instances: 3757ba7d-3058-4402-809d-f211ff48ab91 {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:30:55.313161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b265cd5b-4f5b-4f34-a427-5e3bd27c1465 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097565 Aug 18 12:30:55.313161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 458/907] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:30:55 2022] POST /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 12:30:55.326460 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3c9cd577-7169-4607-8faa-a0a3668dc37c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:55.326951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3c9cd577-7169-4607-8faa-a0a3668dc37c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:55.332899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c9cd577-7169-4607-8faa-a0a3668dc37c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:55.333375 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c9cd577-7169-4607-8faa-a0a3668dc37c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:55.333803 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c9cd577-7169-4607-8faa-a0a3668dc37c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:55.334483 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c9cd577-7169-4607-8faa-a0a3668dc37c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:55.334961 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c9cd577-7169-4607-8faa-a0a3668dc37c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:55.335373 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c9cd577-7169-4607-8faa-a0a3668dc37c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:55.360957 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3c9cd577-7169-4607-8faa-a0a3668dc37c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Going to try to terminate instance {{(pid=121244) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:30:55.534665 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-334ca6b0-6021-4c1f-a783-7961b9e06498 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:55.535387 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-334ca6b0-6021-4c1f-a783-7961b9e06498 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:55.542658 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-334ca6b0-6021-4c1f-a783-7961b9e06498 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:55.543726 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-334ca6b0-6021-4c1f-a783-7961b9e06498 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:55.544155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-334ca6b0-6021-4c1f-a783-7961b9e06498 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:55.544838 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-334ca6b0-6021-4c1f-a783-7961b9e06498 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:55.545312 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-334ca6b0-6021-4c1f-a783-7961b9e06498 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:55.545726 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-334ca6b0-6021-4c1f-a783-7961b9e06498 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:55.612351 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3c9cd577-7169-4607-8faa-a0a3668dc37c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 204 len: 0 microversion: 2.1 time: 0.296905 Aug 18 12:30:55.612854 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 450/908] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:30:55 2022] DELETE /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:30:55.621411 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4f72e675-118b-4e12-8f9f-b0243e4df0b7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:55.622102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4f72e675-118b-4e12-8f9f-b0243e4df0b7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:55.628568 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4f72e675-118b-4e12-8f9f-b0243e4df0b7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:55.629539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4f72e675-118b-4e12-8f9f-b0243e4df0b7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:55.629539 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4f72e675-118b-4e12-8f9f-b0243e4df0b7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:55.630160 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4f72e675-118b-4e12-8f9f-b0243e4df0b7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:55.630604 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4f72e675-118b-4e12-8f9f-b0243e4df0b7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:55.631026 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4f72e675-118b-4e12-8f9f-b0243e4df0b7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:55.683153 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-334ca6b0-6021-4c1f-a783-7961b9e06498 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:55.690819 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-334ca6b0-6021-4c1f-a783-7961b9e06498 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.160148 Aug 18 12:30:55.700887 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 459/909] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:55 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:55.766349 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-4f72e675-118b-4e12-8f9f-b0243e4df0b7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:55.773844 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4f72e675-118b-4e12-8f9f-b0243e4df0b7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1682 microversion: 2.1 time: 0.156573 Aug 18 12:30:55.774427 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 451/910] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:55 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:56.714248 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f76d1399-15e6-40cc-82e6-307a782e3482 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:56.715453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f76d1399-15e6-40cc-82e6-307a782e3482 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:56.722724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f76d1399-15e6-40cc-82e6-307a782e3482 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:56.723223 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f76d1399-15e6-40cc-82e6-307a782e3482 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:56.723699 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f76d1399-15e6-40cc-82e6-307a782e3482 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:56.724398 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f76d1399-15e6-40cc-82e6-307a782e3482 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:56.724854 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f76d1399-15e6-40cc-82e6-307a782e3482 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:56.725304 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f76d1399-15e6-40cc-82e6-307a782e3482 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:56.796881 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-456fca83-e058-410a-8711-427afa2bcd18 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:56.797493 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-456fca83-e058-410a-8711-427afa2bcd18 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:56.804211 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-456fca83-e058-410a-8711-427afa2bcd18 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:56.804696 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-456fca83-e058-410a-8711-427afa2bcd18 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:56.805134 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-456fca83-e058-410a-8711-427afa2bcd18 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:56.805843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-456fca83-e058-410a-8711-427afa2bcd18 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:56.806333 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-456fca83-e058-410a-8711-427afa2bcd18 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:56.806760 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-456fca83-e058-410a-8711-427afa2bcd18 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:56.864591 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f76d1399-15e6-40cc-82e6-307a782e3482 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:56.873143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f76d1399-15e6-40cc-82e6-307a782e3482 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.162761 Aug 18 12:30:56.873751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 460/911] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:56 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:56.935591 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-456fca83-e058-410a-8711-427afa2bcd18 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:56.943095 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-456fca83-e058-410a-8711-427afa2bcd18 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1682 microversion: 2.1 time: 0.150779 Aug 18 12:30:56.943685 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 452/912] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:56 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:57.894231 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6edf251f-77b7-4521-b43d-5f893ecb54c4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:57.894854 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-6edf251f-77b7-4521-b43d-5f893ecb54c4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:57.899878 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-4277fd3a-b4c0-40bb-95bc-df7d03be326f req-bbd7a32f-bccf-4c26-9186-7a28d6fa957c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dffa315-14de-447c-9091-a2ebc33584f8", "name": "network-vif-deleted", "tag": "11642d84-bc85-4e9b-976f-eaade1a13937"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:57.904171 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6edf251f-77b7-4521-b43d-5f893ecb54c4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:57.904316 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6edf251f-77b7-4521-b43d-5f893ecb54c4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:57.904688 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6edf251f-77b7-4521-b43d-5f893ecb54c4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:57.905967 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6edf251f-77b7-4521-b43d-5f893ecb54c4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:57.906421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6edf251f-77b7-4521-b43d-5f893ecb54c4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:57.906837 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6edf251f-77b7-4521-b43d-5f893ecb54c4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:57.914424 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-4277fd3a-b4c0-40bb-95bc-df7d03be326f req-bbd7a32f-bccf-4c26-9186-7a28d6fa957c service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:57.914907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-4277fd3a-b4c0-40bb-95bc-df7d03be326f req-bbd7a32f-bccf-4c26-9186-7a28d6fa957c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:57.915336 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-4277fd3a-b4c0-40bb-95bc-df7d03be326f req-bbd7a32f-bccf-4c26-9186-7a28d6fa957c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:57.928577 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-4277fd3a-b4c0-40bb-95bc-df7d03be326f req-bbd7a32f-bccf-4c26-9186-7a28d6fa957c service nova] Creating event network-vif-deleted:11642d84-bc85-4e9b-976f-eaade1a13937 for instance 9dffa315-14de-447c-9091-a2ebc33584f8 on hv-cinder-83602 Aug 18 12:30:57.938117 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-4277fd3a-b4c0-40bb-95bc-df7d03be326f req-bbd7a32f-bccf-4c26-9186-7a28d6fa957c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042517 Aug 18 12:30:57.939257 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 453/913] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:30:57.967996 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5c05b8cf-6a0d-4dd7-81c6-bf3625e318cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:57.968698 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5c05b8cf-6a0d-4dd7-81c6-bf3625e318cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:57.986168 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5c05b8cf-6a0d-4dd7-81c6-bf3625e318cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:57.986686 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5c05b8cf-6a0d-4dd7-81c6-bf3625e318cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:57.987126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5c05b8cf-6a0d-4dd7-81c6-bf3625e318cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:57.987868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5c05b8cf-6a0d-4dd7-81c6-bf3625e318cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:57.988730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5c05b8cf-6a0d-4dd7-81c6-bf3625e318cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:57.989331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5c05b8cf-6a0d-4dd7-81c6-bf3625e318cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:58.063737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-6edf251f-77b7-4521-b43d-5f893ecb54c4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:58.084875 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-5c05b8cf-6a0d-4dd7-81c6-bf3625e318cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:58.086209 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-6edf251f-77b7-4521-b43d-5f893ecb54c4 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.195553 Aug 18 12:30:58.087035 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 461/914] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:57 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:58.095272 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5c05b8cf-6a0d-4dd7-81c6-bf3625e318cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 200 len: 1615 microversion: 2.1 time: 0.134725 Aug 18 12:30:58.108138 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 454/915] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:57 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 1615 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:59.112848 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b5b97d7b-5527-4e20-8f3d-31aa82a1f922 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:59.118253 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:59.123820 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:59.124162 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b5b97d7b-5527-4e20-8f3d-31aa82a1f922 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:59.125541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:59.126032 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:59.126467 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:59.127174 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:59.127655 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:59.128081 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:59.129581 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5b97d7b-5527-4e20-8f3d-31aa82a1f922 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:59.130367 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5b97d7b-5527-4e20-8f3d-31aa82a1f922 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:59.131184 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5b97d7b-5527-4e20-8f3d-31aa82a1f922 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:59.132006 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5b97d7b-5527-4e20-8f3d-31aa82a1f922 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:59.132467 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5b97d7b-5527-4e20-8f3d-31aa82a1f922 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:59.132893 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b5b97d7b-5527-4e20-8f3d-31aa82a1f922 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:59.144861 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 HTTP/1.1 Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:30:59.146536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:30:59.148207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '9dffa315-14de-447c-9091-a2ebc33584f8'} Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:30:59.149053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:30:59.150342 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:30:59.151637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:30:59.151637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4c5d9ae6-3baf-42a7-8ee7-2985484efc2e tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 404 len: 111 microversion: 2.1 time: 0.033665 Aug 18 12:30:59.151637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 455/916] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:59 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:30:59.157463 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0190309b-11c4-418c-8ac6-e36a0672dfcf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '.version_select at 0x7f3794a23d30>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:59.248135 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0190309b-11c4-418c-8ac6-e36a0672dfcf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015074496" status: 202 len: 0 microversion: 2.1 time: 0.094287 Aug 18 12:30:59.249045 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 456/917] 10.222.0.98 () {58 vars in 1221 bytes} [Thu Aug 18 12:30:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015074496 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:30:59.282205 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b5b97d7b-5527-4e20-8f3d-31aa82a1f922 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:59.289975 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b5b97d7b-5527-4e20-8f3d-31aa82a1f922 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.181050 Aug 18 12:30:59.290482 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 462/918] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:59 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:00.149134 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-97d68426-eef1-4114-ad74-066fec471e17 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:00.149846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-97d68426-eef1-4114-ad74-066fec471e17 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:00.156790 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97d68426-eef1-4114-ad74-066fec471e17 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:00.157279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97d68426-eef1-4114-ad74-066fec471e17 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:00.157730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97d68426-eef1-4114-ad74-066fec471e17 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:00.158403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97d68426-eef1-4114-ad74-066fec471e17 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:00.158854 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97d68426-eef1-4114-ad74-066fec471e17 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:00.159276 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-97d68426-eef1-4114-ad74-066fec471e17 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:00.240218 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-97d68426-eef1-4114-ad74-066fec471e17 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lazy-loading 'services' on Instance uuid 3757ba7d-3058-4402-809d-f211ff48ab91 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:31:00.311913 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c79835be-99d0-40b2-b4b3-179926a844c7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:00.321317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c79835be-99d0-40b2-b4b3-179926a844c7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:00.321317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c79835be-99d0-40b2-b4b3-179926a844c7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:00.321317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c79835be-99d0-40b2-b4b3-179926a844c7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:00.321317 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c79835be-99d0-40b2-b4b3-179926a844c7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:00.321735 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c79835be-99d0-40b2-b4b3-179926a844c7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:00.321735 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c79835be-99d0-40b2-b4b3-179926a844c7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:00.321735 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c79835be-99d0-40b2-b4b3-179926a844c7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:00.451517 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c79835be-99d0-40b2-b4b3-179926a844c7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:00.459072 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c79835be-99d0-40b2-b4b3-179926a844c7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.151607 Aug 18 12:31:00.459671 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 463/919] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:00 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:00.479628 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-97d68426-eef1-4114-ad74-066fec471e17 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/os-volume_attachments/b183fd08-e1ff-47a4-a80c-64989929b709" status: 202 len: 0 microversion: 2.1 time: 0.334980 Aug 18 12:31:00.480287 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 457/920] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:31:00 2022] DELETE /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/os-volume_attachments/b183fd08-e1ff-47a4-a80c-64989929b709 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:31:00.493299 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8dffbb4f-81cb-481f-8951-55d5f1a6de33 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:00.495588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8dffbb4f-81cb-481f-8951-55d5f1a6de33 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:00.501561 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8dffbb4f-81cb-481f-8951-55d5f1a6de33 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:00.502036 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8dffbb4f-81cb-481f-8951-55d5f1a6de33 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:00.502473 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8dffbb4f-81cb-481f-8951-55d5f1a6de33 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:00.503159 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8dffbb4f-81cb-481f-8951-55d5f1a6de33 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:00.503640 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8dffbb4f-81cb-481f-8951-55d5f1a6de33 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:00.504063 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8dffbb4f-81cb-481f-8951-55d5f1a6de33 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:00.533495 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8dffbb4f-81cb-481f-8951-55d5f1a6de33 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 Aug 18 12:31:00.534050 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 464/921] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:31:00 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:01.482000 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-42877968-089d-4676-92f3-08a3c426ccce tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:01.482702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-42877968-089d-4676-92f3-08a3c426ccce tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:01.489231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42877968-089d-4676-92f3-08a3c426ccce tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:01.491671 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42877968-089d-4676-92f3-08a3c426ccce tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:01.491671 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42877968-089d-4676-92f3-08a3c426ccce tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:01.491671 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42877968-089d-4676-92f3-08a3c426ccce tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:01.491671 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42877968-089d-4676-92f3-08a3c426ccce tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:01.492128 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-42877968-089d-4676-92f3-08a3c426ccce tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:01.547155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0da643fe-0cce-460c-9518-b0ad8dbd1899 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:01.549502 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0da643fe-0cce-460c-9518-b0ad8dbd1899 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:01.556324 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0da643fe-0cce-460c-9518-b0ad8dbd1899 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:01.556806 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0da643fe-0cce-460c-9518-b0ad8dbd1899 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:01.557238 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0da643fe-0cce-460c-9518-b0ad8dbd1899 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:01.557933 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0da643fe-0cce-460c-9518-b0ad8dbd1899 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:01.558395 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0da643fe-0cce-460c-9518-b0ad8dbd1899 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:01.558805 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0da643fe-0cce-460c-9518-b0ad8dbd1899 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:01.588670 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0da643fe-0cce-460c-9518-b0ad8dbd1899 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046135 Aug 18 12:31:01.589232 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 465/922] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:31:01 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 12:31:01.641073 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-42877968-089d-4676-92f3-08a3c426ccce tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:01.645028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-42877968-089d-4676-92f3-08a3c426ccce tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.168151 Aug 18 12:31:01.645578 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 458/923] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:01 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:01.652907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-08b0442a-5333-4414-9679-ad1a5bf588cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:01.653495 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-08b0442a-5333-4414-9679-ad1a5bf588cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:01.659645 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-08b0442a-5333-4414-9679-ad1a5bf588cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:01.660132 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-08b0442a-5333-4414-9679-ad1a5bf588cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:01.660624 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-08b0442a-5333-4414-9679-ad1a5bf588cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:01.661318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-08b0442a-5333-4414-9679-ad1a5bf588cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:01.661774 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-08b0442a-5333-4414-9679-ad1a5bf588cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:01.662199 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-08b0442a-5333-4414-9679-ad1a5bf588cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:01.688719 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-08b0442a-5333-4414-9679-ad1a5bf588cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:31:02.086406 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-08b0442a-5333-4414-9679-ad1a5bf588cf tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 204 len: 0 microversion: 2.1 time: 0.437241 Aug 18 12:31:02.087000 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 466/924] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:31:01 2022] DELETE /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:31:02.096162 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-563dfc28-e78c-48b2-afd6-17b8ee3c0f7a tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:02.096910 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-563dfc28-e78c-48b2-afd6-17b8ee3c0f7a tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:02.103293 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-563dfc28-e78c-48b2-afd6-17b8ee3c0f7a tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:02.103823 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-563dfc28-e78c-48b2-afd6-17b8ee3c0f7a tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:02.104268 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-563dfc28-e78c-48b2-afd6-17b8ee3c0f7a tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:02.104961 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-563dfc28-e78c-48b2-afd6-17b8ee3c0f7a tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:02.105455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-563dfc28-e78c-48b2-afd6-17b8ee3c0f7a tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:02.105883 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-563dfc28-e78c-48b2-afd6-17b8ee3c0f7a tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:02.238088 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-563dfc28-e78c-48b2-afd6-17b8ee3c0f7a tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:02.246074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-563dfc28-e78c-48b2-afd6-17b8ee3c0f7a tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1681 microversion: 2.1 time: 0.154080 Aug 18 12:31:02.246651 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 459/925] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:02 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:02.666296 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-29a19f64-67d8-4993-8e9d-7f48a470a618 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:02.666989 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-29a19f64-67d8-4993-8e9d-7f48a470a618 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:02.673550 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-29a19f64-67d8-4993-8e9d-7f48a470a618 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:02.679138 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-29a19f64-67d8-4993-8e9d-7f48a470a618 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:02.679138 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-29a19f64-67d8-4993-8e9d-7f48a470a618 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:02.679138 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-29a19f64-67d8-4993-8e9d-7f48a470a618 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:02.679138 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-29a19f64-67d8-4993-8e9d-7f48a470a618 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:02.679568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-29a19f64-67d8-4993-8e9d-7f48a470a618 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:02.813584 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-29a19f64-67d8-4993-8e9d-7f48a470a618 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:02.821400 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-29a19f64-67d8-4993-8e9d-7f48a470a618 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.159269 Aug 18 12:31:02.821970 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 467/926] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:02 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:03.269460 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-0188022a-2b87-4cc0-a72a-0575d3b6c9a0 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:03.270071 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-0188022a-2b87-4cc0-a72a-0575d3b6c9a0 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:03.276527 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0188022a-2b87-4cc0-a72a-0575d3b6c9a0 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:03.277009 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0188022a-2b87-4cc0-a72a-0575d3b6c9a0 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:03.277451 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0188022a-2b87-4cc0-a72a-0575d3b6c9a0 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:03.278140 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0188022a-2b87-4cc0-a72a-0575d3b6c9a0 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:03.278592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0188022a-2b87-4cc0-a72a-0575d3b6c9a0 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:03.279019 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-0188022a-2b87-4cc0-a72a-0575d3b6c9a0 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:03.413053 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-0188022a-2b87-4cc0-a72a-0575d3b6c9a0 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:03.416614 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:03.421564 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-0188022a-2b87-4cc0-a72a-0575d3b6c9a0 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1681 microversion: 2.1 time: 0.156078 Aug 18 12:31:03.422180 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 460/927] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:03 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:03.842804 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f6a56d10-cde6-462c-86ea-ce8c96863f60 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:03.843860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f6a56d10-cde6-462c-86ea-ce8c96863f60 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:03.850670 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6a56d10-cde6-462c-86ea-ce8c96863f60 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:03.851134 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6a56d10-cde6-462c-86ea-ce8c96863f60 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:03.851672 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6a56d10-cde6-462c-86ea-ce8c96863f60 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:03.852375 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6a56d10-cde6-462c-86ea-ce8c96863f60 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:03.852827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6a56d10-cde6-462c-86ea-ce8c96863f60 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:03.853250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6a56d10-cde6-462c-86ea-ce8c96863f60 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:03.985865 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f6a56d10-cde6-462c-86ea-ce8c96863f60 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:03.993550 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f6a56d10-cde6-462c-86ea-ce8c96863f60 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.155253 Aug 18 12:31:03.994123 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 468/928] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:03 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:04.412104 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-49c14796-d7ac-4b1f-b245-f3251ee30a9d req-4f7ed279-79d8-45ad-910b-7bfcd969d56e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3757ba7d-3058-4402-809d-f211ff48ab91", "name": "network-vif-deleted", "tag": "c39795df-aa38-41cd-a915-613253053131"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:04.423924 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-49c14796-d7ac-4b1f-b245-f3251ee30a9d req-4f7ed279-79d8-45ad-910b-7bfcd969d56e service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:04.424418 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-49c14796-d7ac-4b1f-b245-f3251ee30a9d req-4f7ed279-79d8-45ad-910b-7bfcd969d56e service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:04.424843 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-49c14796-d7ac-4b1f-b245-f3251ee30a9d req-4f7ed279-79d8-45ad-910b-7bfcd969d56e service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:04.436820 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-49c14796-d7ac-4b1f-b245-f3251ee30a9d req-4f7ed279-79d8-45ad-910b-7bfcd969d56e service nova] Creating event network-vif-deleted:c39795df-aa38-41cd-a915-613253053131 for instance 3757ba7d-3058-4402-809d-f211ff48ab91 on hv-cinder-83602 Aug 18 12:31:04.442316 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-49c14796-d7ac-4b1f-b245-f3251ee30a9d req-4f7ed279-79d8-45ad-910b-7bfcd969d56e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034081 Aug 18 12:31:04.442920 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 461/929] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:04.453982 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3b7a1bb6-6b70-441b-b578-ca5dc12b4d08 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:04.454609 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3b7a1bb6-6b70-441b-b578-ca5dc12b4d08 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:04.460791 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b7a1bb6-6b70-441b-b578-ca5dc12b4d08 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:04.461289 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b7a1bb6-6b70-441b-b578-ca5dc12b4d08 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:04.461722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b7a1bb6-6b70-441b-b578-ca5dc12b4d08 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:04.462780 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b7a1bb6-6b70-441b-b578-ca5dc12b4d08 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:04.463465 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b7a1bb6-6b70-441b-b578-ca5dc12b4d08 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:04.464065 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b7a1bb6-6b70-441b-b578-ca5dc12b4d08 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:04.533653 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3b7a1bb6-6b70-441b-b578-ca5dc12b4d08 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:04.543025 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:04.550183 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3b7a1bb6-6b70-441b-b578-ca5dc12b4d08 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 200 len: 1613 microversion: 2.1 time: 0.101390 Aug 18 12:31:04.551004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 469/930] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:04 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:05.015775 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-bc4a983a-ed50-449a-a701-9767ae2dbfb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:05.016507 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-bc4a983a-ed50-449a-a701-9767ae2dbfb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:05.023446 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc4a983a-ed50-449a-a701-9767ae2dbfb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:05.023951 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc4a983a-ed50-449a-a701-9767ae2dbfb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:05.024387 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc4a983a-ed50-449a-a701-9767ae2dbfb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:05.025087 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc4a983a-ed50-449a-a701-9767ae2dbfb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:05.025542 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc4a983a-ed50-449a-a701-9767ae2dbfb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:05.025969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bc4a983a-ed50-449a-a701-9767ae2dbfb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:05.261089 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bc4a983a-ed50-449a-a701-9767ae2dbfb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:05.271210 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-bc4a983a-ed50-449a-a701-9767ae2dbfb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.259444 Aug 18 12:31:05.271827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 462/931] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:05 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:05.572200 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:05.572800 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:05.580056 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:05.580529 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:05.580952 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:05.581633 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:05.582078 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:05.582492 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:05.596085 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 HTTP/1.1 Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:31:05.597705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:31:05.599453 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '3757ba7d-3058-4402-809d-f211ff48ab91'} Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:31:05.600313 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:31:05.601809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:31:05.603004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:31:05.603004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-daaf2b27-c9d2-470b-893b-6f003a6d84f7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 404 len: 111 microversion: 2.1 time: 0.030792 Aug 18 12:31:05.603004 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 470/932] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:05 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:31:05.608822 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-bf02a86f-ed15-479d-baf3-3157589db96f tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '.version_select at 0x7f3787ec0ee0>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:05.704481 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-bf02a86f-ed15-479d-baf3-3157589db96f tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-334638729" status: 202 len: 0 microversion: 2.1 time: 0.100009 Aug 18 12:31:05.705061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 463/933] 10.222.0.98 () {58 vars in 1218 bytes} [Thu Aug 18 12:31:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-334638729 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:31:06.294147 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0bf5be6a-e725-4e75-b248-18577d2ddc86 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:06.294865 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0bf5be6a-e725-4e75-b248-18577d2ddc86 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:06.301512 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0bf5be6a-e725-4e75-b248-18577d2ddc86 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:06.301996 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0bf5be6a-e725-4e75-b248-18577d2ddc86 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:06.302415 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0bf5be6a-e725-4e75-b248-18577d2ddc86 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:06.303098 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0bf5be6a-e725-4e75-b248-18577d2ddc86 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:06.304301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0bf5be6a-e725-4e75-b248-18577d2ddc86 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:06.304724 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0bf5be6a-e725-4e75-b248-18577d2ddc86 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:06.511161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0bf5be6a-e725-4e75-b248-18577d2ddc86 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:06.519454 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0bf5be6a-e725-4e75-b248-18577d2ddc86 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.229151 Aug 18 12:31:06.520001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 471/934] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:06 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:06.556611 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d9b4b5e9-9f43-4d7e-83fd-5511af5854f4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: .version_select at 0x7f3787ef7040>, body: {"keypair": {"name": "tempest-keypair-1092103636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp6OfMg81q85FxglYAJfHclH5dQnU3XlhEUNjqyODjF9R0IF/stLiI2rAqV/j8bsC5scacjDM5zeUDvloVYv0AJzG9ucEMgZC8KICwXveZDCV8dpR8UJVFvW69brHb6zw=="}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:06.572244 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-d9b4b5e9-9f43-4d7e-83fd-5511af5854f4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:31:06.576777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-d9b4b5e9-9f43-4d7e-83fd-5511af5854f4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for user 27ed3f0ca7c44672a42aa774b02de88c and project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:31:06.647352 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d9b4b5e9-9f43-4d7e-83fd-5511af5854f4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094736 Aug 18 12:31:06.648071 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 464/935] 10.222.0.98 () {60 vars in 1159 bytes} [Thu Aug 18 12:31:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:07.174123 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-0a8a1da2-644c-49df-810a-c1bddafd8e20 req-d34ea117-ff43-4320-ae88-bc3e3bf565c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26fb4ea-80d1-405d-b693-2fe9cbe2f45c", "name": "network-vif-unplugged", "status": "completed", "tag": "dc009460-8a64-46d7-ba37-594be57137d0"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:07.185599 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-0a8a1da2-644c-49df-810a-c1bddafd8e20 req-d34ea117-ff43-4320-ae88-bc3e3bf565c8 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:07.186089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-0a8a1da2-644c-49df-810a-c1bddafd8e20 req-d34ea117-ff43-4320-ae88-bc3e3bf565c8 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:07.186670 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-0a8a1da2-644c-49df-810a-c1bddafd8e20 req-d34ea117-ff43-4320-ae88-bc3e3bf565c8 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:07.199320 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-0a8a1da2-644c-49df-810a-c1bddafd8e20 req-d34ea117-ff43-4320-ae88-bc3e3bf565c8 service nova] Creating event network-vif-unplugged:dc009460-8a64-46d7-ba37-594be57137d0 for instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c on hv-cinder-83602 Aug 18 12:31:07.204576 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-0a8a1da2-644c-49df-810a-c1bddafd8e20 req-d34ea117-ff43-4320-ae88-bc3e3bf565c8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040689 Aug 18 12:31:07.205163 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 472/936] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:07.541949 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-006c6975-4e85-4372-8ec8-17f39ccb3f72 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:07.542576 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-006c6975-4e85-4372-8ec8-17f39ccb3f72 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:07.548999 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-006c6975-4e85-4372-8ec8-17f39ccb3f72 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:07.554669 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-006c6975-4e85-4372-8ec8-17f39ccb3f72 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:07.554669 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-006c6975-4e85-4372-8ec8-17f39ccb3f72 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:07.554669 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-006c6975-4e85-4372-8ec8-17f39ccb3f72 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:07.554669 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-006c6975-4e85-4372-8ec8-17f39ccb3f72 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:07.555090 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-006c6975-4e85-4372-8ec8-17f39ccb3f72 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:07.714220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-006c6975-4e85-4372-8ec8-17f39ccb3f72 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:07.722707 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-006c6975-4e85-4372-8ec8-17f39ccb3f72 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.185699 Aug 18 12:31:07.723266 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 465/937] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:07 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:08.744469 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5ae4dce5-5f57-4741-ab05-77fd3805d3d1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:08.745163 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5ae4dce5-5f57-4741-ab05-77fd3805d3d1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:08.751991 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5ae4dce5-5f57-4741-ab05-77fd3805d3d1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:08.752468 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5ae4dce5-5f57-4741-ab05-77fd3805d3d1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:08.752896 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5ae4dce5-5f57-4741-ab05-77fd3805d3d1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:08.753665 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5ae4dce5-5f57-4741-ab05-77fd3805d3d1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:08.754118 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5ae4dce5-5f57-4741-ab05-77fd3805d3d1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:08.754541 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5ae4dce5-5f57-4741-ab05-77fd3805d3d1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:08.892754 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5ae4dce5-5f57-4741-ab05-77fd3805d3d1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:08.900582 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5ae4dce5-5f57-4741-ab05-77fd3805d3d1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1509 microversion: 2.1 time: 0.160388 Aug 18 12:31:08.901163 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 473/938] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:08 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:08.925304 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-38476b80-ee5f-4a2f-8412-b4914bf00369 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:08.926290 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-38476b80-ee5f-4a2f-8412-b4914bf00369 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:08.934465 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38476b80-ee5f-4a2f-8412-b4914bf00369 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:08.934465 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38476b80-ee5f-4a2f-8412-b4914bf00369 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:08.934465 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38476b80-ee5f-4a2f-8412-b4914bf00369 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:08.935115 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38476b80-ee5f-4a2f-8412-b4914bf00369 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:08.935596 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38476b80-ee5f-4a2f-8412-b4914bf00369 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:08.936020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-38476b80-ee5f-4a2f-8412-b4914bf00369 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:08.964373 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-38476b80-ee5f-4a2f-8412-b4914bf00369 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121244) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 18 12:31:09.127643 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2117131999", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e16b12d6-9788-4022-91a7-d06421bd0ecc"}], "security_groups": [{"name": "tempest-securitygroup--304630421"}], "key_name": "tempest-keypair-1092103636", "user_data": "}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:09.232231 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.network.neutron [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] validate_networks() for [('e16b12d6-9788-4022-91a7-d06421bd0ecc', None, None, None, None, None)] {{(pid=121245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:31:09.305719 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-38476b80-ee5f-4a2f-8412-b4914bf00369 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "POST /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c/action" status: 202 len: 0 microversion: 2.1 time: 0.387531 Aug 18 12:31:09.306891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 466/939] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Aug 18 12:31:08 2022] POST /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:31:09.314671 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-926273dd-1660-4ca0-af24-bb496e87698d tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:09.315287 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-926273dd-1660-4ca0-af24-bb496e87698d tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:09.322356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-926273dd-1660-4ca0-af24-bb496e87698d tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:09.323291 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-926273dd-1660-4ca0-af24-bb496e87698d tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:09.323784 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-926273dd-1660-4ca0-af24-bb496e87698d tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:09.324943 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-926273dd-1660-4ca0-af24-bb496e87698d tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:09.325896 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-926273dd-1660-4ca0-af24-bb496e87698d tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:09.326315 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-926273dd-1660-4ca0-af24-bb496e87698d tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:09.469073 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-926273dd-1660-4ca0-af24-bb496e87698d tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:09.476889 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-926273dd-1660-4ca0-af24-bb496e87698d tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1517 microversion: 2.1 time: 0.166343 Aug 18 12:31:09.477494 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 467/940] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:09 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:09.710220 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Flavor limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:31:09.710675 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Image limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:31:09.711181 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Flavor pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:31:09.711622 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Image pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:31:09.712039 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:31:09.721253 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:09.721732 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:09.722168 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:09.723089 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:09.723574 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:09.724000 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:09.741587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:31:09.745568 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for user 27ed3f0ca7c44672a42aa774b02de88c and project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:31:09.757869 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Going to run 1 instances... {{(pid=121245) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:31:09.760173 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:31:09.866950 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-bb67190a-577d-4b6a-9aad-d38dc45181c2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.743740 Aug 18 12:31:09.867640 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 474/941] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:31:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:31:09.878998 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-42a21ea1-655e-4f8a-bd3c-10e4056dfaf2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:09.879839 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-42a21ea1-655e-4f8a-bd3c-10e4056dfaf2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:09.945006 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-42a21ea1-655e-4f8a-bd3c-10e4056dfaf2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:09.953018 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-42a21ea1-655e-4f8a-bd3c-10e4056dfaf2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1242 microversion: 2.1 time: 0.077783 Aug 18 12:31:09.953602 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 468/942] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:09 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:10.498321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b3f2eb38-f947-419e-ba04-e80d6a119eb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:10.498978 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b3f2eb38-f947-419e-ba04-e80d6a119eb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:10.506030 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3f2eb38-f947-419e-ba04-e80d6a119eb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:10.506516 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3f2eb38-f947-419e-ba04-e80d6a119eb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:10.506950 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3f2eb38-f947-419e-ba04-e80d6a119eb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:10.507772 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3f2eb38-f947-419e-ba04-e80d6a119eb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:10.508226 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3f2eb38-f947-419e-ba04-e80d6a119eb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:10.508649 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3f2eb38-f947-419e-ba04-e80d6a119eb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:10.649174 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b3f2eb38-f947-419e-ba04-e80d6a119eb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:10.657569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b3f2eb38-f947-419e-ba04-e80d6a119eb2 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1517 microversion: 2.1 time: 0.163380 Aug 18 12:31:10.658130 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 475/943] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:10 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:10.980028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-976dd509-c441-4f8c-99f9-04520e7a31b2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:10.980647 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-976dd509-c441-4f8c-99f9-04520e7a31b2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:10.987819 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-976dd509-c441-4f8c-99f9-04520e7a31b2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:10.988311 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-976dd509-c441-4f8c-99f9-04520e7a31b2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:10.988753 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-976dd509-c441-4f8c-99f9-04520e7a31b2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:10.989452 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-976dd509-c441-4f8c-99f9-04520e7a31b2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:10.989909 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-976dd509-c441-4f8c-99f9-04520e7a31b2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:10.990338 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-976dd509-c441-4f8c-99f9-04520e7a31b2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:11.052210 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-976dd509-c441-4f8c-99f9-04520e7a31b2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:11.060429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-976dd509-c441-4f8c-99f9-04520e7a31b2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1246 microversion: 2.1 time: 0.084377 Aug 18 12:31:11.060969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 469/944] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:10 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:11.678809 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0401b829-e995-4c9a-9b53-992097cf1ccb tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:11.679345 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0401b829-e995-4c9a-9b53-992097cf1ccb tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:11.685920 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0401b829-e995-4c9a-9b53-992097cf1ccb tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:11.686407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0401b829-e995-4c9a-9b53-992097cf1ccb tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:11.686843 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0401b829-e995-4c9a-9b53-992097cf1ccb tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:11.687570 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0401b829-e995-4c9a-9b53-992097cf1ccb tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:11.688020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0401b829-e995-4c9a-9b53-992097cf1ccb tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:11.688444 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0401b829-e995-4c9a-9b53-992097cf1ccb tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:11.836407 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-0401b829-e995-4c9a-9b53-992097cf1ccb tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:11.850733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0401b829-e995-4c9a-9b53-992097cf1ccb tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1519 microversion: 2.1 time: 0.176186 Aug 18 12:31:11.851726 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 476/945] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:11 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:12.081491 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-be2cf93c-18d5-4de0-8f28-ea16b621538d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:12.082824 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-be2cf93c-18d5-4de0-8f28-ea16b621538d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:12.093472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be2cf93c-18d5-4de0-8f28-ea16b621538d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:12.093472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be2cf93c-18d5-4de0-8f28-ea16b621538d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:12.093472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be2cf93c-18d5-4de0-8f28-ea16b621538d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:12.093472 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be2cf93c-18d5-4de0-8f28-ea16b621538d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:12.094846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be2cf93c-18d5-4de0-8f28-ea16b621538d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:12.095598 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be2cf93c-18d5-4de0-8f28-ea16b621538d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:12.211343 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-be2cf93c-18d5-4de0-8f28-ea16b621538d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:12.225559 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-be2cf93c-18d5-4de0-8f28-ea16b621538d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1312 microversion: 2.1 time: 0.147957 Aug 18 12:31:12.226221 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 470/946] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:12 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:12.874176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-518170a4-1c6c-454c-b7ed-958c29d21a27 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:12.874955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-518170a4-1c6c-454c-b7ed-958c29d21a27 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:12.882245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-518170a4-1c6c-454c-b7ed-958c29d21a27 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:12.882867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-518170a4-1c6c-454c-b7ed-958c29d21a27 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:12.883725 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-518170a4-1c6c-454c-b7ed-958c29d21a27 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:12.884677 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-518170a4-1c6c-454c-b7ed-958c29d21a27 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:12.885133 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-518170a4-1c6c-454c-b7ed-958c29d21a27 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:12.885564 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-518170a4-1c6c-454c-b7ed-958c29d21a27 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:13.122576 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-518170a4-1c6c-454c-b7ed-958c29d21a27 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:13.135844 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-518170a4-1c6c-454c-b7ed-958c29d21a27 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1575 microversion: 2.1 time: 0.266546 Aug 18 12:31:13.136423 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 477/947] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:12 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1575 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:13.250266 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-eed457f4-050d-4361-b3e9-e449ed17b74c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:13.250969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-eed457f4-050d-4361-b3e9-e449ed17b74c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:13.259151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eed457f4-050d-4361-b3e9-e449ed17b74c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:13.259151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eed457f4-050d-4361-b3e9-e449ed17b74c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:13.259151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eed457f4-050d-4361-b3e9-e449ed17b74c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:13.259871 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eed457f4-050d-4361-b3e9-e449ed17b74c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:13.260448 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eed457f4-050d-4361-b3e9-e449ed17b74c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:13.261168 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-eed457f4-050d-4361-b3e9-e449ed17b74c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:13.297866 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-c26a2a56-1725-4e0e-9486-aeb60a13d202 req-d5bafcee-cac8-485e-8ea2-1cf1978921a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c5df6e-7b55-47e0-b043-61faf4dac47b", "tag": "1f0b2751-be34-4be9-850c-b45247ed016d"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:13.308261 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-c26a2a56-1725-4e0e-9486-aeb60a13d202 req-d5bafcee-cac8-485e-8ea2-1cf1978921a6 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:13.308743 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-c26a2a56-1725-4e0e-9486-aeb60a13d202 req-d5bafcee-cac8-485e-8ea2-1cf1978921a6 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:13.309234 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-c26a2a56-1725-4e0e-9486-aeb60a13d202 req-d5bafcee-cac8-485e-8ea2-1cf1978921a6 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:13.320326 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-c26a2a56-1725-4e0e-9486-aeb60a13d202 req-d5bafcee-cac8-485e-8ea2-1cf1978921a6 service nova] Creating event network-changed:1f0b2751-be34-4be9-850c-b45247ed016d for instance 96c5df6e-7b55-47e0-b043-61faf4dac47b on hv-cinder-83602 Aug 18 12:31:13.325262 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-c26a2a56-1725-4e0e-9486-aeb60a13d202 req-d5bafcee-cac8-485e-8ea2-1cf1978921a6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031257 Aug 18 12:31:13.328130 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 478/948] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:13.432798 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-eed457f4-050d-4361-b3e9-e449ed17b74c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:13.440198 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-eed457f4-050d-4361-b3e9-e449ed17b74c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1367 microversion: 2.1 time: 0.194221 Aug 18 12:31:13.440757 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 471/949] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:13 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:14.158319 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a5a5f041-be1b-42ea-8418-4eb0c40334ff tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:14.159021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a5a5f041-be1b-42ea-8418-4eb0c40334ff tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:14.165376 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a5f041-be1b-42ea-8418-4eb0c40334ff tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:14.165907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a5f041-be1b-42ea-8418-4eb0c40334ff tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:14.166348 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a5f041-be1b-42ea-8418-4eb0c40334ff tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:14.167045 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a5f041-be1b-42ea-8418-4eb0c40334ff tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:14.167528 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a5f041-be1b-42ea-8418-4eb0c40334ff tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:14.167952 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a5a5f041-be1b-42ea-8418-4eb0c40334ff tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:14.300366 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a5a5f041-be1b-42ea-8418-4eb0c40334ff tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:14.308039 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a5a5f041-be1b-42ea-8418-4eb0c40334ff tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1575 microversion: 2.1 time: 0.154884 Aug 18 12:31:14.308605 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 479/950] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:14 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:14.461798 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3324aa47-f948-490f-9844-bf62023e2641 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:14.462403 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3324aa47-f948-490f-9844-bf62023e2641 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:14.469715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3324aa47-f948-490f-9844-bf62023e2641 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:14.470192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3324aa47-f948-490f-9844-bf62023e2641 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:14.470626 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3324aa47-f948-490f-9844-bf62023e2641 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:14.471443 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3324aa47-f948-490f-9844-bf62023e2641 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:14.471888 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3324aa47-f948-490f-9844-bf62023e2641 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:14.472329 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3324aa47-f948-490f-9844-bf62023e2641 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:14.614696 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3324aa47-f948-490f-9844-bf62023e2641 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:14.619065 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3324aa47-f948-490f-9844-bf62023e2641 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1367 microversion: 2.1 time: 0.161217 Aug 18 12:31:14.619663 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 472/951] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:14 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:15.328981 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-662e8ada-845e-425a-a0b7-7fa9ac1558c6 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:15.329595 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-662e8ada-845e-425a-a0b7-7fa9ac1558c6 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:15.336093 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-662e8ada-845e-425a-a0b7-7fa9ac1558c6 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:15.336573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-662e8ada-845e-425a-a0b7-7fa9ac1558c6 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:15.337013 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-662e8ada-845e-425a-a0b7-7fa9ac1558c6 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:15.337704 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-662e8ada-845e-425a-a0b7-7fa9ac1558c6 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:15.338156 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-662e8ada-845e-425a-a0b7-7fa9ac1558c6 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:15.338582 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-662e8ada-845e-425a-a0b7-7fa9ac1558c6 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:15.479766 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-662e8ada-845e-425a-a0b7-7fa9ac1558c6 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:15.487987 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-662e8ada-845e-425a-a0b7-7fa9ac1558c6 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1575 microversion: 2.1 time: 0.162886 Aug 18 12:31:15.488679 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 480/952] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:15 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:15.640043 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-398041d7-75f5-4e1f-a6a4-879afda7de44 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:15.640646 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-398041d7-75f5-4e1f-a6a4-879afda7de44 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:15.647212 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-398041d7-75f5-4e1f-a6a4-879afda7de44 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:15.647672 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-398041d7-75f5-4e1f-a6a4-879afda7de44 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:15.648110 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-398041d7-75f5-4e1f-a6a4-879afda7de44 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:15.648819 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-398041d7-75f5-4e1f-a6a4-879afda7de44 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:15.649254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-398041d7-75f5-4e1f-a6a4-879afda7de44 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:15.649678 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-398041d7-75f5-4e1f-a6a4-879afda7de44 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:15.784267 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-398041d7-75f5-4e1f-a6a4-879afda7de44 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:15.791947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-398041d7-75f5-4e1f-a6a4-879afda7de44 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1367 microversion: 2.1 time: 0.155677 Aug 18 12:31:15.792529 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 473/953] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:15 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:16.508898 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7e886677-fa95-4939-87cd-ee80ca4f9cbc tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:16.509507 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7e886677-fa95-4939-87cd-ee80ca4f9cbc tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:16.515961 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7e886677-fa95-4939-87cd-ee80ca4f9cbc tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:16.516437 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7e886677-fa95-4939-87cd-ee80ca4f9cbc tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:16.516871 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7e886677-fa95-4939-87cd-ee80ca4f9cbc tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:16.517552 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7e886677-fa95-4939-87cd-ee80ca4f9cbc tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:16.518001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7e886677-fa95-4939-87cd-ee80ca4f9cbc tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:16.518419 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7e886677-fa95-4939-87cd-ee80ca4f9cbc tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:16.647780 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7e886677-fa95-4939-87cd-ee80ca4f9cbc tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:16.655525 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7e886677-fa95-4939-87cd-ee80ca4f9cbc tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1575 microversion: 2.1 time: 0.150416 Aug 18 12:31:16.656094 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 481/954] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:16 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:16.813099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-9912b99d-2475-41e0-81ba-8613a70c0b92 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:16.813646 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-9912b99d-2475-41e0-81ba-8613a70c0b92 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:16.820145 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9912b99d-2475-41e0-81ba-8613a70c0b92 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:16.820627 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9912b99d-2475-41e0-81ba-8613a70c0b92 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:16.821071 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9912b99d-2475-41e0-81ba-8613a70c0b92 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:16.821767 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9912b99d-2475-41e0-81ba-8613a70c0b92 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:16.822220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9912b99d-2475-41e0-81ba-8613a70c0b92 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:16.822651 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9912b99d-2475-41e0-81ba-8613a70c0b92 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:16.950117 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-9912b99d-2475-41e0-81ba-8613a70c0b92 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:16.957501 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-9912b99d-2475-41e0-81ba-8613a70c0b92 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1367 microversion: 2.1 time: 0.149011 Aug 18 12:31:16.958276 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 474/955] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:16 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:17.688288 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e943680b-5e16-46d5-82b6-b207274a9c18 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:17.688831 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e943680b-5e16-46d5-82b6-b207274a9c18 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:17.695790 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e943680b-5e16-46d5-82b6-b207274a9c18 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:17.695901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e943680b-5e16-46d5-82b6-b207274a9c18 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:17.696289 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e943680b-5e16-46d5-82b6-b207274a9c18 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:17.696990 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e943680b-5e16-46d5-82b6-b207274a9c18 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:17.697443 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e943680b-5e16-46d5-82b6-b207274a9c18 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:17.697867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e943680b-5e16-46d5-82b6-b207274a9c18 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:17.830678 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-e943680b-5e16-46d5-82b6-b207274a9c18 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:17.838598 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e943680b-5e16-46d5-82b6-b207274a9c18 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1575 microversion: 2.1 time: 0.154918 Aug 18 12:31:17.839169 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 482/956] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:17 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:17.978289 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-164165ce-ddfd-4eff-a314-2a3e845f9297 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:17.979017 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-164165ce-ddfd-4eff-a314-2a3e845f9297 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:17.986105 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-164165ce-ddfd-4eff-a314-2a3e845f9297 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:17.986590 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-164165ce-ddfd-4eff-a314-2a3e845f9297 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:17.987024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-164165ce-ddfd-4eff-a314-2a3e845f9297 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:17.987746 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-164165ce-ddfd-4eff-a314-2a3e845f9297 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:17.988196 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-164165ce-ddfd-4eff-a314-2a3e845f9297 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:17.988617 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-164165ce-ddfd-4eff-a314-2a3e845f9297 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:18.123516 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-164165ce-ddfd-4eff-a314-2a3e845f9297 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:18.131164 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-164165ce-ddfd-4eff-a314-2a3e845f9297 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1367 microversion: 2.1 time: 0.156837 Aug 18 12:31:18.131746 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 475/957] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:17 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:18.859022 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2932ff1c-b1bf-40c4-93fa-a5d5ec87c521 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:18.859745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-2932ff1c-b1bf-40c4-93fa-a5d5ec87c521 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:18.865924 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2932ff1c-b1bf-40c4-93fa-a5d5ec87c521 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:18.866402 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2932ff1c-b1bf-40c4-93fa-a5d5ec87c521 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:18.869914 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2932ff1c-b1bf-40c4-93fa-a5d5ec87c521 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:18.869914 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2932ff1c-b1bf-40c4-93fa-a5d5ec87c521 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:18.869914 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2932ff1c-b1bf-40c4-93fa-a5d5ec87c521 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:18.869914 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2932ff1c-b1bf-40c4-93fa-a5d5ec87c521 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:19.007631 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2932ff1c-b1bf-40c4-93fa-a5d5ec87c521 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:19.015938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2932ff1c-b1bf-40c4-93fa-a5d5ec87c521 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1575 microversion: 2.1 time: 0.160823 Aug 18 12:31:19.016506 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 483/958] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:18 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:19.151712 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-59f7b1a0-264a-4e61-8592-433f43ed0825 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:19.152324 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-59f7b1a0-264a-4e61-8592-433f43ed0825 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:19.159106 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-59f7b1a0-264a-4e61-8592-433f43ed0825 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:19.159631 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-59f7b1a0-264a-4e61-8592-433f43ed0825 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:19.160070 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-59f7b1a0-264a-4e61-8592-433f43ed0825 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:19.160813 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-59f7b1a0-264a-4e61-8592-433f43ed0825 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:19.161265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-59f7b1a0-264a-4e61-8592-433f43ed0825 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:19.161716 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-59f7b1a0-264a-4e61-8592-433f43ed0825 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:19.226201 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-5ca0b71d-5fff-418c-9ccd-7b7553ee134f req-57992d92-3937-4cd5-ba7a-2f1cd18f6902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c5df6e-7b55-47e0-b043-61faf4dac47b", "name": "network-vif-plugged", "status": "completed", "tag": "1f0b2751-be34-4be9-850c-b45247ed016d"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:19.236001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-5ca0b71d-5fff-418c-9ccd-7b7553ee134f req-57992d92-3937-4cd5-ba7a-2f1cd18f6902 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:19.236482 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-5ca0b71d-5fff-418c-9ccd-7b7553ee134f req-57992d92-3937-4cd5-ba7a-2f1cd18f6902 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:19.236981 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-5ca0b71d-5fff-418c-9ccd-7b7553ee134f req-57992d92-3937-4cd5-ba7a-2f1cd18f6902 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:19.253294 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-5ca0b71d-5fff-418c-9ccd-7b7553ee134f req-57992d92-3937-4cd5-ba7a-2f1cd18f6902 service nova] Creating event network-vif-plugged:1f0b2751-be34-4be9-850c-b45247ed016d for instance 96c5df6e-7b55-47e0-b043-61faf4dac47b on hv-cinder-83602 Aug 18 12:31:19.258462 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-5ca0b71d-5fff-418c-9ccd-7b7553ee134f req-57992d92-3937-4cd5-ba7a-2f1cd18f6902 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092701 Aug 18 12:31:19.259337 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 484/959] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:31:19.307756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-59f7b1a0-264a-4e61-8592-433f43ed0825 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:19.316546 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-59f7b1a0-264a-4e61-8592-433f43ed0825 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1367 microversion: 2.1 time: 0.168756 Aug 18 12:31:19.317281 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 476/960] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:19 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:20.035332 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:20.036143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=6 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:20.040628 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a58dadd6-9bc6-4bd7-968a-9ec41d9bee38 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:20.041328 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-a58dadd6-9bc6-4bd7-968a-9ec41d9bee38 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:20.048065 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a58dadd6-9bc6-4bd7-968a-9ec41d9bee38 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:20.048661 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a58dadd6-9bc6-4bd7-968a-9ec41d9bee38 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:20.048974 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a58dadd6-9bc6-4bd7-968a-9ec41d9bee38 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:20.049664 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a58dadd6-9bc6-4bd7-968a-9ec41d9bee38 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:20.050139 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a58dadd6-9bc6-4bd7-968a-9ec41d9bee38 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:20.050562 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-a58dadd6-9bc6-4bd7-968a-9ec41d9bee38 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:20.183766 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-a58dadd6-9bc6-4bd7-968a-9ec41d9bee38 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:20.191711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a58dadd6-9bc6-4bd7-968a-9ec41d9bee38 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1575 microversion: 2.1 time: 0.157262 Aug 18 12:31:20.192281 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 485/961] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:20 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:20.338093 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f3e97b8d-75b8-43dc-99b3-0ce50b2e2e97 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:20.338693 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f3e97b8d-75b8-43dc-99b3-0ce50b2e2e97 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:20.341309 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=6 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:20.342405 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:20.347303 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3e97b8d-75b8-43dc-99b3-0ce50b2e2e97 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:20.347819 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3e97b8d-75b8-43dc-99b3-0ce50b2e2e97 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:20.348246 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3e97b8d-75b8-43dc-99b3-0ce50b2e2e97 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:20.348932 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3e97b8d-75b8-43dc-99b3-0ce50b2e2e97 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:20.349378 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3e97b8d-75b8-43dc-99b3-0ce50b2e2e97 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:20.349794 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f3e97b8d-75b8-43dc-99b3-0ce50b2e2e97 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:20.486446 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f3e97b8d-75b8-43dc-99b3-0ce50b2e2e97 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:20.493957 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f3e97b8d-75b8-43dc-99b3-0ce50b2e2e97 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1367 microversion: 2.1 time: 0.159726 Aug 18 12:31:20.494567 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 477/962] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:20 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:21.211828 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6eb5d500-1e1d-45f1-b71f-d3217f38b204 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:21.212441 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-6eb5d500-1e1d-45f1-b71f-d3217f38b204 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:21.219143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6eb5d500-1e1d-45f1-b71f-d3217f38b204 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:21.219663 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6eb5d500-1e1d-45f1-b71f-d3217f38b204 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:21.220102 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6eb5d500-1e1d-45f1-b71f-d3217f38b204 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:21.220791 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6eb5d500-1e1d-45f1-b71f-d3217f38b204 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:21.221244 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6eb5d500-1e1d-45f1-b71f-d3217f38b204 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:21.221673 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6eb5d500-1e1d-45f1-b71f-d3217f38b204 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:21.362704 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-6eb5d500-1e1d-45f1-b71f-d3217f38b204 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:21.370510 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-6eb5d500-1e1d-45f1-b71f-d3217f38b204 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1575 microversion: 2.1 time: 0.162488 Aug 18 12:31:21.371086 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 486/963] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:21 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:21.514544 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f5b37036-7cb5-4e6d-bbc2-90339e7b146d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:21.515137 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f5b37036-7cb5-4e6d-bbc2-90339e7b146d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:21.522956 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5b37036-7cb5-4e6d-bbc2-90339e7b146d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:21.523455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5b37036-7cb5-4e6d-bbc2-90339e7b146d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:21.523891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5b37036-7cb5-4e6d-bbc2-90339e7b146d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:21.524592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5b37036-7cb5-4e6d-bbc2-90339e7b146d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:21.525050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5b37036-7cb5-4e6d-bbc2-90339e7b146d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:21.525473 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f5b37036-7cb5-4e6d-bbc2-90339e7b146d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:21.661640 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f5b37036-7cb5-4e6d-bbc2-90339e7b146d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:21.673122 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f5b37036-7cb5-4e6d-bbc2-90339e7b146d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1557 microversion: 2.1 time: 0.162814 Aug 18 12:31:21.673919 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 478/964] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:21 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:21.693542 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1d13d62f-4bdf-43c4-a8bc-3e7d4b516589 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:21.694035 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1d13d62f-4bdf-43c4-a8bc-3e7d4b516589 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:21.700388 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d13d62f-4bdf-43c4-a8bc-3e7d4b516589 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:21.700870 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d13d62f-4bdf-43c4-a8bc-3e7d4b516589 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:21.701307 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d13d62f-4bdf-43c4-a8bc-3e7d4b516589 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:21.702008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d13d62f-4bdf-43c4-a8bc-3e7d4b516589 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:21.702466 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d13d62f-4bdf-43c4-a8bc-3e7d4b516589 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:21.702882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1d13d62f-4bdf-43c4-a8bc-3e7d4b516589 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:21.782091 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1d13d62f-4bdf-43c4-a8bc-3e7d4b516589 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092389 Aug 18 12:31:21.782685 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 487/965] 10.222.0.98 () {58 vars in 1275 bytes} [Thu Aug 18 12:31:21 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:22.394665 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-71247a6c-df4d-42ec-8e48-ab518d48072b tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:22.395184 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-71247a6c-df4d-42ec-8e48-ab518d48072b tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:22.401210 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-71247a6c-df4d-42ec-8e48-ab518d48072b tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:22.401695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-71247a6c-df4d-42ec-8e48-ab518d48072b tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:22.402128 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-71247a6c-df4d-42ec-8e48-ab518d48072b tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:22.402823 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-71247a6c-df4d-42ec-8e48-ab518d48072b tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:22.403276 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-71247a6c-df4d-42ec-8e48-ab518d48072b tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:22.403733 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-71247a6c-df4d-42ec-8e48-ab518d48072b tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:22.643623 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-71247a6c-df4d-42ec-8e48-ab518d48072b tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:22.651273 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-71247a6c-df4d-42ec-8e48-ab518d48072b tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1575 microversion: 2.1 time: 0.261658 Aug 18 12:31:22.652090 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 479/966] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:22 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:22.914235 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-97d2e5a7-19a2-4c32-9e62-4e3df41e4128 req-df13f604-264b-4b08-b323-1cb3910a78bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c5df6e-7b55-47e0-b043-61faf4dac47b", "tag": "1f0b2751-be34-4be9-850c-b45247ed016d"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:22.919654 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:22.924868 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-97d2e5a7-19a2-4c32-9e62-4e3df41e4128 req-df13f604-264b-4b08-b323-1cb3910a78bd service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:22.925353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-97d2e5a7-19a2-4c32-9e62-4e3df41e4128 req-df13f604-264b-4b08-b323-1cb3910a78bd service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:22.925774 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-97d2e5a7-19a2-4c32-9e62-4e3df41e4128 req-df13f604-264b-4b08-b323-1cb3910a78bd service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:22.937057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-97d2e5a7-19a2-4c32-9e62-4e3df41e4128 req-df13f604-264b-4b08-b323-1cb3910a78bd service nova] Creating event network-changed:1f0b2751-be34-4be9-850c-b45247ed016d for instance 96c5df6e-7b55-47e0-b043-61faf4dac47b on hv-cinder-83602 Aug 18 12:31:22.942233 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-97d2e5a7-19a2-4c32-9e62-4e3df41e4128 req-df13f604-264b-4b08-b323-1cb3910a78bd service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087629 Aug 18 12:31:22.942842 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 488/967] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:23.427220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-34d236be-23f6-40d4-92ea-56f59035aed7 req-cd1cb1bf-aa13-4433-8dc3-9fc13dca0d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26fb4ea-80d1-405d-b693-2fe9cbe2f45c", "name": "network-vif-plugged", "status": "completed", "tag": "dc009460-8a64-46d7-ba37-594be57137d0"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:23.438907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-34d236be-23f6-40d4-92ea-56f59035aed7 req-cd1cb1bf-aa13-4433-8dc3-9fc13dca0d6c service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:23.439390 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-34d236be-23f6-40d4-92ea-56f59035aed7 req-cd1cb1bf-aa13-4433-8dc3-9fc13dca0d6c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:23.439874 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-34d236be-23f6-40d4-92ea-56f59035aed7 req-cd1cb1bf-aa13-4433-8dc3-9fc13dca0d6c service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:23.444918 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:23.453872 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-34d236be-23f6-40d4-92ea-56f59035aed7 req-cd1cb1bf-aa13-4433-8dc3-9fc13dca0d6c service nova] Creating event network-vif-plugged:dc009460-8a64-46d7-ba37-594be57137d0 for instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c on hv-cinder-83602 Aug 18 12:31:23.459577 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-34d236be-23f6-40d4-92ea-56f59035aed7 req-cd1cb1bf-aa13-4433-8dc3-9fc13dca0d6c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035892 Aug 18 12:31:23.460020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 480/968] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:23.681789 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b3c76a86-3a3b-42df-95d8-bcc96b6d0358 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:23.682861 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b3c76a86-3a3b-42df-95d8-bcc96b6d0358 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:23.690214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3c76a86-3a3b-42df-95d8-bcc96b6d0358 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:23.690803 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3c76a86-3a3b-42df-95d8-bcc96b6d0358 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:23.691338 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3c76a86-3a3b-42df-95d8-bcc96b6d0358 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:23.692147 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3c76a86-3a3b-42df-95d8-bcc96b6d0358 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:23.692672 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3c76a86-3a3b-42df-95d8-bcc96b6d0358 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:23.693399 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3c76a86-3a3b-42df-95d8-bcc96b6d0358 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:23.850688 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b3c76a86-3a3b-42df-95d8-bcc96b6d0358 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:23.859264 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b3c76a86-3a3b-42df-95d8-bcc96b6d0358 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1575 microversion: 2.1 time: 0.190132 Aug 18 12:31:23.859863 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 489/969] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:23 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:24.881982 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-990870b1-cef8-43f9-99c5-87ea1be7ddf0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:24.882664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-990870b1-cef8-43f9-99c5-87ea1be7ddf0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:24.889115 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-990870b1-cef8-43f9-99c5-87ea1be7ddf0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:24.889592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-990870b1-cef8-43f9-99c5-87ea1be7ddf0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:24.892121 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-990870b1-cef8-43f9-99c5-87ea1be7ddf0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:24.892121 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-990870b1-cef8-43f9-99c5-87ea1be7ddf0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:24.892121 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-990870b1-cef8-43f9-99c5-87ea1be7ddf0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:24.892121 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-990870b1-cef8-43f9-99c5-87ea1be7ddf0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:25.024251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-990870b1-cef8-43f9-99c5-87ea1be7ddf0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:25.031719 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-990870b1-cef8-43f9-99c5-87ea1be7ddf0 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1575 microversion: 2.1 time: 0.154558 Aug 18 12:31:25.032275 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 481/970] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:24 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:26.053286 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2c515430-9740-4228-b067-c9af0f877014 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:26.054015 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-2c515430-9740-4228-b067-c9af0f877014 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:26.061096 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2c515430-9740-4228-b067-c9af0f877014 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:26.061582 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2c515430-9740-4228-b067-c9af0f877014 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:26.062020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2c515430-9740-4228-b067-c9af0f877014 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:26.062739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2c515430-9740-4228-b067-c9af0f877014 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:26.063194 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2c515430-9740-4228-b067-c9af0f877014 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:26.063649 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-2c515430-9740-4228-b067-c9af0f877014 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:26.197100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-2c515430-9740-4228-b067-c9af0f877014 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:26.201242 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=100 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:26.205665 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2c515430-9740-4228-b067-c9af0f877014 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1562 microversion: 2.1 time: 0.156345 Aug 18 12:31:26.206230 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 490/971] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:26 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:28.718020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-1f3ba2ff-f257-46c1-9934-f13b2324ecab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:28.718551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-1f3ba2ff-f257-46c1-9934-f13b2324ecab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:28.725110 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1f3ba2ff-f257-46c1-9934-f13b2324ecab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:28.725595 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1f3ba2ff-f257-46c1-9934-f13b2324ecab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:28.726033 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1f3ba2ff-f257-46c1-9934-f13b2324ecab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:28.726737 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1f3ba2ff-f257-46c1-9934-f13b2324ecab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:28.727193 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1f3ba2ff-f257-46c1-9934-f13b2324ecab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:28.727654 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-1f3ba2ff-f257-46c1-9934-f13b2324ecab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:28.752077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-1f3ba2ff-f257-46c1-9934-f13b2324ecab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Going to try to terminate instance {{(pid=121244) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:31:29.007810 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-1f3ba2ff-f257-46c1-9934-f13b2324ecab tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 204 len: 0 microversion: 2.1 time: 0.292900 Aug 18 12:31:29.007810 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 482/972] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:31:28 2022] DELETE /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:31:29.020322 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-80d43d78-4168-4d02-b1a1-09bcb894ae6f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:29.020845 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-80d43d78-4168-4d02-b1a1-09bcb894ae6f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:29.027634 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80d43d78-4168-4d02-b1a1-09bcb894ae6f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:29.028124 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80d43d78-4168-4d02-b1a1-09bcb894ae6f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:29.028563 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80d43d78-4168-4d02-b1a1-09bcb894ae6f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:29.029288 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80d43d78-4168-4d02-b1a1-09bcb894ae6f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:29.029760 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80d43d78-4168-4d02-b1a1-09bcb894ae6f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:29.030187 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-80d43d78-4168-4d02-b1a1-09bcb894ae6f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:29.165300 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-80d43d78-4168-4d02-b1a1-09bcb894ae6f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:29.172794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-80d43d78-4168-4d02-b1a1-09bcb894ae6f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1577 microversion: 2.1 time: 0.161305 Aug 18 12:31:29.173366 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 491/973] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:29 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:30.194703 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c09ee43c-e803-43d2-9942-5b91e0763d95 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:30.195636 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c09ee43c-e803-43d2-9942-5b91e0763d95 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:30.202729 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c09ee43c-e803-43d2-9942-5b91e0763d95 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:30.203217 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c09ee43c-e803-43d2-9942-5b91e0763d95 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:30.203689 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c09ee43c-e803-43d2-9942-5b91e0763d95 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:30.204396 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c09ee43c-e803-43d2-9942-5b91e0763d95 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:30.204852 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c09ee43c-e803-43d2-9942-5b91e0763d95 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:30.208084 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c09ee43c-e803-43d2-9942-5b91e0763d95 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:30.340834 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c09ee43c-e803-43d2-9942-5b91e0763d95 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:30.348827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c09ee43c-e803-43d2-9942-5b91e0763d95 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1577 microversion: 2.1 time: 0.158431 Aug 18 12:31:30.349394 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 483/974] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:30 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:31.361098 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-79581359-13bc-4644-a999-ee9b999fe024 req-42444eec-6f74-4c14-a90c-b19e2525dcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3d0863-3d23-4709-83a9-12686e8b3e7d", "name": "network-vif-deleted", "tag": "1995adb2-e636-4547-963d-8b7702c12099"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:31.370538 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8a4eab2e-00e2-42d9-a43a-64dfdeb3616a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:31.372675 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8a4eab2e-00e2-42d9-a43a-64dfdeb3616a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:31.373552 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-79581359-13bc-4644-a999-ee9b999fe024 req-42444eec-6f74-4c14-a90c-b19e2525dcd1 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:31.374222 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-79581359-13bc-4644-a999-ee9b999fe024 req-42444eec-6f74-4c14-a90c-b19e2525dcd1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:31.376021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-79581359-13bc-4644-a999-ee9b999fe024 req-42444eec-6f74-4c14-a90c-b19e2525dcd1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:31.381222 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8a4eab2e-00e2-42d9-a43a-64dfdeb3616a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:31.381713 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8a4eab2e-00e2-42d9-a43a-64dfdeb3616a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:31.382182 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8a4eab2e-00e2-42d9-a43a-64dfdeb3616a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:31.382957 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8a4eab2e-00e2-42d9-a43a-64dfdeb3616a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:31.383488 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8a4eab2e-00e2-42d9-a43a-64dfdeb3616a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:31.383909 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-8a4eab2e-00e2-42d9-a43a-64dfdeb3616a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:31.387635 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-79581359-13bc-4644-a999-ee9b999fe024 req-42444eec-6f74-4c14-a90c-b19e2525dcd1 service nova] Creating event network-vif-deleted:1995adb2-e636-4547-963d-8b7702c12099 for instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d on hv-cinder-83602 Aug 18 12:31:31.393073 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-79581359-13bc-4644-a999-ee9b999fe024 req-42444eec-6f74-4c14-a90c-b19e2525dcd1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036187 Aug 18 12:31:31.394037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 492/975] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:31.460030 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8a4eab2e-00e2-42d9-a43a-64dfdeb3616a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:31.470721 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8a4eab2e-00e2-42d9-a43a-64dfdeb3616a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1509 microversion: 2.1 time: 0.104455 Aug 18 12:31:31.471309 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 484/976] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:31 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1509 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:32.492581 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:32.493496 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:32.501875 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:32.502468 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:32.503009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:32.503888 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:32.504343 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:32.504767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:32.536979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:32.537462 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:32.537928 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:32.538372 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lazy-loading 'fault' on Instance uuid 3b3d0863-3d23-4709-83a9-12686e8b3e7d {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:31:32.581801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:32.594074 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c3d75937-0299-4bd6-a3fa-41c37a06a687 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 200 len: 1230 microversion: 2.1 time: 0.105801 Aug 18 12:31:32.639619 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 493/977] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:32 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:33.618050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:33.619970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:33.625435 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:33.625922 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:33.626360 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:33.627059 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:33.627542 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:33.627970 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:33.642062 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] HTTP exception thrown: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Request method failure captured: Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d HTTP/1.1 Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jB5ivz6GwSMa00-FhhKDStZkfuCLiurvTueLGpHGVWjfMc2uAVtKugOj_dU6xg-nsCF6t5KxzFgbf8K_lOzYQ1y3ywSViTWb6GZEBOoB0D31GOPG4Gm9_ePPgGQIHhRuH1eBrDils2b39-okZoDCLrWwXbFx7vEoyJ81HMi2oIynSM Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: c1534d6a880c4f44b741ff5b208663bc Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-TestVolumeBootPattern-323659931 Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:31:33.643730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-TestVolumeBootPattern-323659931 Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: c1534d6a880c4f44b741ff5b208663bc Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-TestVolumeBootPattern-323659931 Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-TestVolumeBootPattern-323659931-project Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 3907830851364a73b4d3715280a132bc Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-TestVolumeBootPattern-323659931-project Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:31:33.645381 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '3b3d0863-3d23-4709-83a9-12686e8b3e7d'} Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:31:33.646415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:31:33.648028 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:31:33.649443 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Returning 404 to user: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:31:33.649443 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-4db9613c-ab82-41e3-96c8-b570c995f0bb tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 404 len: 111 microversion: 2.1 time: 0.030931 Aug 18 12:31:33.649868 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 485/978] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:33 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:31:33.696428 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-436325508", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-229203386", "security_groups": [{"name": "tempest-secgroup-smoke-2046157390"}], "block_device_mapping_v2": [{"uuid": "15bde9cd-bf3c-4954-bb91-a66b2061e150", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4f234a1b-725a-4b27-82c4-838eed1ed10a"}]}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:33.814963 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.network.neutron [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] validate_networks() for [('4f234a1b-725a-4b27-82c4-838eed1ed10a', None, None, None, None, None)] {{(pid=121245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:31:34.180097 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Flavor limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:31:34.180527 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Image limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:31:34.181032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Flavor pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:31:34.181440 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Image pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:31:34.181851 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:31:34.190787 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:34.191264 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:34.191730 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:34.192461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:34.192922 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:34.193345 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:34.210014 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Getting quotas for project c1534d6a880c4f44b741ff5b208663bc. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:31:34.214090 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Getting quotas for user 3907830851364a73b4d3715280a132bc and project c1534d6a880c4f44b741ff5b208663bc. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:31:34.272079 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Going to run 1 instances... {{(pid=121245) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:31:34.274143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15bde9cd-bf3c-4954-bb91-a66b2061e150',volume_size=None,volume_type=None)] {{(pid=121245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:31:34.748214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-8a30de26-a83f-4988-97cb-02066acd1718 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.056079 Aug 18 12:31:34.748983 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 494/979] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:31:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:31:34.760009 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d6af4984-294b-4a04-a467-12f2e6af69d6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:34.760688 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d6af4984-294b-4a04-a467-12f2e6af69d6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:34.824787 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d6af4984-294b-4a04-a467-12f2e6af69d6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:34.832006 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d6af4984-294b-4a04-a467-12f2e6af69d6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1093 microversion: 2.1 time: 0.075615 Aug 18 12:31:34.833320 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 486/980] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:34 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:35.854533 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-48723aca-b3bc-4f72-92da-b1c1b3b9b0bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:35.855150 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-48723aca-b3bc-4f72-92da-b1c1b3b9b0bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:35.861439 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-48723aca-b3bc-4f72-92da-b1c1b3b9b0bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:35.861867 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-48723aca-b3bc-4f72-92da-b1c1b3b9b0bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:35.862308 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-48723aca-b3bc-4f72-92da-b1c1b3b9b0bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:35.863001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-48723aca-b3bc-4f72-92da-b1c1b3b9b0bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:35.863495 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-48723aca-b3bc-4f72-92da-b1c1b3b9b0bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:35.863904 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-48723aca-b3bc-4f72-92da-b1c1b3b9b0bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:35.926308 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-48723aca-b3bc-4f72-92da-b1c1b3b9b0bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:35.933986 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-48723aca-b3bc-4f72-92da-b1c1b3b9b0bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1143 microversion: 2.1 time: 0.083780 Aug 18 12:31:35.934536 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 495/981] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:35 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:36.954778 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-22e95802-d005-4bb3-a0e6-bef19346bd27 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:36.955463 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-22e95802-d005-4bb3-a0e6-bef19346bd27 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:36.962932 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-22e95802-d005-4bb3-a0e6-bef19346bd27 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:36.963443 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-22e95802-d005-4bb3-a0e6-bef19346bd27 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:36.963889 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-22e95802-d005-4bb3-a0e6-bef19346bd27 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:36.964588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-22e95802-d005-4bb3-a0e6-bef19346bd27 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:36.965043 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-22e95802-d005-4bb3-a0e6-bef19346bd27 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:36.965470 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-22e95802-d005-4bb3-a0e6-bef19346bd27 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:37.044253 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-22e95802-d005-4bb3-a0e6-bef19346bd27 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:37.052721 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-22e95802-d005-4bb3-a0e6-bef19346bd27 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1209 microversion: 2.1 time: 0.101791 Aug 18 12:31:37.053294 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 487/982] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:36 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:38.073418 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f9582b42-6088-4e56-b0e0-98ede4632f9a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:38.074253 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f9582b42-6088-4e56-b0e0-98ede4632f9a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:38.081395 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9582b42-6088-4e56-b0e0-98ede4632f9a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:38.081894 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9582b42-6088-4e56-b0e0-98ede4632f9a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:38.082323 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9582b42-6088-4e56-b0e0-98ede4632f9a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:38.083028 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9582b42-6088-4e56-b0e0-98ede4632f9a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:38.083503 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9582b42-6088-4e56-b0e0-98ede4632f9a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:38.083930 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f9582b42-6088-4e56-b0e0-98ede4632f9a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:38.223674 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f9582b42-6088-4e56-b0e0-98ede4632f9a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:38.231147 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f9582b42-6088-4e56-b0e0-98ede4632f9a tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.161551 Aug 18 12:31:38.231753 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 496/983] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:38 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:38.350880 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-c67fa4b0-0a51-4c6b-833d-645b3c051d44 req-0a6730a8-f581-468e-b76e-38c5f6f06d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4dd9b1-2d50-4008-9a96-c7cd11cea37c", "tag": "0ab0be7e-e022-4bcb-88d5-2fd5d954c6cd"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:38.361504 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-c67fa4b0-0a51-4c6b-833d-645b3c051d44 req-0a6730a8-f581-468e-b76e-38c5f6f06d97 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:38.361989 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-c67fa4b0-0a51-4c6b-833d-645b3c051d44 req-0a6730a8-f581-468e-b76e-38c5f6f06d97 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:38.362425 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-c67fa4b0-0a51-4c6b-833d-645b3c051d44 req-0a6730a8-f581-468e-b76e-38c5f6f06d97 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:38.375363 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-c67fa4b0-0a51-4c6b-833d-645b3c051d44 req-0a6730a8-f581-468e-b76e-38c5f6f06d97 service nova] Creating event network-changed:0ab0be7e-e022-4bcb-88d5-2fd5d954c6cd for instance 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c on hv-cinder-83602 Aug 18 12:31:38.380663 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-c67fa4b0-0a51-4c6b-833d-645b3c051d44 req-0a6730a8-f581-468e-b76e-38c5f6f06d97 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033845 Aug 18 12:31:38.381794 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 488/984] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:39.253137 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-99d429e0-ec28-4154-97db-5d077f3245ba tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:39.253740 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-99d429e0-ec28-4154-97db-5d077f3245ba tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:39.260360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-99d429e0-ec28-4154-97db-5d077f3245ba tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:39.260849 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-99d429e0-ec28-4154-97db-5d077f3245ba tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:39.261286 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-99d429e0-ec28-4154-97db-5d077f3245ba tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:39.261990 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-99d429e0-ec28-4154-97db-5d077f3245ba tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:39.262446 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-99d429e0-ec28-4154-97db-5d077f3245ba tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:39.262869 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-99d429e0-ec28-4154-97db-5d077f3245ba tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:39.397620 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-99d429e0-ec28-4154-97db-5d077f3245ba tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:39.405784 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-99d429e0-ec28-4154-97db-5d077f3245ba tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.156556 Aug 18 12:31:39.406347 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 497/985] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:39 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:40.428020 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-272822cf-2035-44c3-83ca-074922074fb6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:40.428719 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-272822cf-2035-44c3-83ca-074922074fb6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:40.434822 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-272822cf-2035-44c3-83ca-074922074fb6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:40.435303 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-272822cf-2035-44c3-83ca-074922074fb6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:40.435764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-272822cf-2035-44c3-83ca-074922074fb6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:40.437038 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-272822cf-2035-44c3-83ca-074922074fb6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:40.437497 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-272822cf-2035-44c3-83ca-074922074fb6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:40.437925 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-272822cf-2035-44c3-83ca-074922074fb6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:40.574286 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-272822cf-2035-44c3-83ca-074922074fb6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:40.583684 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-272822cf-2035-44c3-83ca-074922074fb6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.160201 Aug 18 12:31:40.584266 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 489/986] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:40 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:41.604611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5fb67d1c-aaa6-419c-9d93-9c8a4e5a9b34 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:41.605246 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5fb67d1c-aaa6-419c-9d93-9c8a4e5a9b34 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:41.612273 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5fb67d1c-aaa6-419c-9d93-9c8a4e5a9b34 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:41.612751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5fb67d1c-aaa6-419c-9d93-9c8a4e5a9b34 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:41.613185 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5fb67d1c-aaa6-419c-9d93-9c8a4e5a9b34 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:41.613875 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5fb67d1c-aaa6-419c-9d93-9c8a4e5a9b34 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:41.614321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5fb67d1c-aaa6-419c-9d93-9c8a4e5a9b34 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:41.614746 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5fb67d1c-aaa6-419c-9d93-9c8a4e5a9b34 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:41.749772 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-5fb67d1c-aaa6-419c-9d93-9c8a4e5a9b34 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:41.757619 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5fb67d1c-aaa6-419c-9d93-9c8a4e5a9b34 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.156826 Aug 18 12:31:41.758195 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 498/987] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:41 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:42.778384 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-491892a9-b602-4e28-acc4-2f16fbea472f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:42.778962 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-491892a9-b602-4e28-acc4-2f16fbea472f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:42.785738 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-491892a9-b602-4e28-acc4-2f16fbea472f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:42.786186 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-491892a9-b602-4e28-acc4-2f16fbea472f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:42.786574 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-491892a9-b602-4e28-acc4-2f16fbea472f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:42.787264 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-491892a9-b602-4e28-acc4-2f16fbea472f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:42.788115 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-491892a9-b602-4e28-acc4-2f16fbea472f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:42.788240 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-491892a9-b602-4e28-acc4-2f16fbea472f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:42.919461 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-491892a9-b602-4e28-acc4-2f16fbea472f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:42.927455 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-491892a9-b602-4e28-acc4-2f16fbea472f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.153062 Aug 18 12:31:42.928017 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 490/988] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:42 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:43.948603 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6670e143-83e2-425d-ab65-6ce7153ab3bf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:43.949173 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-6670e143-83e2-425d-ab65-6ce7153ab3bf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:43.956191 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6670e143-83e2-425d-ab65-6ce7153ab3bf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:43.956664 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6670e143-83e2-425d-ab65-6ce7153ab3bf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:43.957091 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6670e143-83e2-425d-ab65-6ce7153ab3bf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:43.957769 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6670e143-83e2-425d-ab65-6ce7153ab3bf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:43.958212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6670e143-83e2-425d-ab65-6ce7153ab3bf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:43.958626 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6670e143-83e2-425d-ab65-6ce7153ab3bf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:44.092824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-6670e143-83e2-425d-ab65-6ce7153ab3bf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:44.100652 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-6670e143-83e2-425d-ab65-6ce7153ab3bf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.155752 Aug 18 12:31:44.101635 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 499/989] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:43 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:45.122537 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-335199c8-59b7-4e15-aac7-ae60fe96d8f5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:45.123148 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-335199c8-59b7-4e15-aac7-ae60fe96d8f5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:45.126265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:45.131038 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-335199c8-59b7-4e15-aac7-ae60fe96d8f5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:45.131620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-335199c8-59b7-4e15-aac7-ae60fe96d8f5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:45.132102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-335199c8-59b7-4e15-aac7-ae60fe96d8f5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:45.133156 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-335199c8-59b7-4e15-aac7-ae60fe96d8f5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:45.133280 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-335199c8-59b7-4e15-aac7-ae60fe96d8f5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:45.133661 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-335199c8-59b7-4e15-aac7-ae60fe96d8f5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:45.267787 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-335199c8-59b7-4e15-aac7-ae60fe96d8f5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:45.275392 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-335199c8-59b7-4e15-aac7-ae60fe96d8f5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.156721 Aug 18 12:31:45.281587 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 491/990] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:45 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:46.297067 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-be555190-3006-435b-9f3a-baa2450b2cdc tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:46.297667 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-be555190-3006-435b-9f3a-baa2450b2cdc tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:46.299645 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:46.300443 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=6 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:46.305479 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be555190-3006-435b-9f3a-baa2450b2cdc tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:46.305954 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be555190-3006-435b-9f3a-baa2450b2cdc tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:46.306381 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be555190-3006-435b-9f3a-baa2450b2cdc tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:46.307054 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be555190-3006-435b-9f3a-baa2450b2cdc tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:46.307526 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be555190-3006-435b-9f3a-baa2450b2cdc tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:46.307945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-be555190-3006-435b-9f3a-baa2450b2cdc tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:46.440079 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-be555190-3006-435b-9f3a-baa2450b2cdc tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:46.447663 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-be555190-3006-435b-9f3a-baa2450b2cdc tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.155066 Aug 18 12:31:46.448226 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 500/991] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:46 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:47.468657 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-29253e6f-0e17-4b9c-a2b0-5d42401950af tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:47.469259 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-29253e6f-0e17-4b9c-a2b0-5d42401950af tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:47.475652 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-29253e6f-0e17-4b9c-a2b0-5d42401950af tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:47.476128 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-29253e6f-0e17-4b9c-a2b0-5d42401950af tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:47.476557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-29253e6f-0e17-4b9c-a2b0-5d42401950af tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:47.477237 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-29253e6f-0e17-4b9c-a2b0-5d42401950af tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:47.477685 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-29253e6f-0e17-4b9c-a2b0-5d42401950af tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:47.478106 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-29253e6f-0e17-4b9c-a2b0-5d42401950af tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:47.617067 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-29253e6f-0e17-4b9c-a2b0-5d42401950af tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:47.625457 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-29253e6f-0e17-4b9c-a2b0-5d42401950af tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.160814 Aug 18 12:31:47.626040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 492/992] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:47 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:48.646304 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c0c3024f-cbf6-421d-a03f-bcea2d9153ee tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:48.646890 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c0c3024f-cbf6-421d-a03f-bcea2d9153ee tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:48.653620 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0c3024f-cbf6-421d-a03f-bcea2d9153ee tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:48.654107 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0c3024f-cbf6-421d-a03f-bcea2d9153ee tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:48.655094 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0c3024f-cbf6-421d-a03f-bcea2d9153ee tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:48.655832 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0c3024f-cbf6-421d-a03f-bcea2d9153ee tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:48.656288 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0c3024f-cbf6-421d-a03f-bcea2d9153ee tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:48.656712 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c0c3024f-cbf6-421d-a03f-bcea2d9153ee tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:48.794426 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c0c3024f-cbf6-421d-a03f-bcea2d9153ee tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:48.802212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c0c3024f-cbf6-421d-a03f-bcea2d9153ee tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.159888 Aug 18 12:31:48.802771 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 501/993] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:48 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:49.333520 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-4eb43b4c-9217-48fa-a9bd-a853d262f4f9 req-7529aa10-5c65-41b2-aba4-df8fa0472c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4dd9b1-2d50-4008-9a96-c7cd11cea37c", "name": "network-vif-plugged", "status": "completed", "tag": "0ab0be7e-e022-4bcb-88d5-2fd5d954c6cd"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:49.344620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-4eb43b4c-9217-48fa-a9bd-a853d262f4f9 req-7529aa10-5c65-41b2-aba4-df8fa0472c68 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:49.345099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-4eb43b4c-9217-48fa-a9bd-a853d262f4f9 req-7529aa10-5c65-41b2-aba4-df8fa0472c68 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:49.345528 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-4eb43b4c-9217-48fa-a9bd-a853d262f4f9 req-7529aa10-5c65-41b2-aba4-df8fa0472c68 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:49.360649 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-4eb43b4c-9217-48fa-a9bd-a853d262f4f9 req-7529aa10-5c65-41b2-aba4-df8fa0472c68 service nova] Creating event network-vif-plugged:0ab0be7e-e022-4bcb-88d5-2fd5d954c6cd for instance 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c on hv-cinder-83602 Aug 18 12:31:49.362870 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-4eb43b4c-9217-48fa-a9bd-a853d262f4f9 req-7529aa10-5c65-41b2-aba4-df8fa0472c68 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033394 Aug 18 12:31:49.363776 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 493/994] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:49.822362 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f6ff5c04-e968-46d8-bd99-75c8ca7dba82 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:49.824150 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f6ff5c04-e968-46d8-bd99-75c8ca7dba82 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:49.830491 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ff5c04-e968-46d8-bd99-75c8ca7dba82 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:49.830982 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ff5c04-e968-46d8-bd99-75c8ca7dba82 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:49.831473 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ff5c04-e968-46d8-bd99-75c8ca7dba82 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:49.832173 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ff5c04-e968-46d8-bd99-75c8ca7dba82 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:49.832627 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ff5c04-e968-46d8-bd99-75c8ca7dba82 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:49.833055 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f6ff5c04-e968-46d8-bd99-75c8ca7dba82 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:49.966646 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f6ff5c04-e968-46d8-bd99-75c8ca7dba82 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:49.974229 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f6ff5c04-e968-46d8-bd99-75c8ca7dba82 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.155774 Aug 18 12:31:49.974793 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 502/995] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:49 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:50.995879 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-17c8bf1b-5a46-4edc-bf0f-5ea431c7de18 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:50.996551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-17c8bf1b-5a46-4edc-bf0f-5ea431c7de18 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:51.002678 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17c8bf1b-5a46-4edc-bf0f-5ea431c7de18 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:51.004207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17c8bf1b-5a46-4edc-bf0f-5ea431c7de18 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:51.004207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17c8bf1b-5a46-4edc-bf0f-5ea431c7de18 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:51.004391 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17c8bf1b-5a46-4edc-bf0f-5ea431c7de18 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:51.004713 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17c8bf1b-5a46-4edc-bf0f-5ea431c7de18 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:51.005130 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17c8bf1b-5a46-4edc-bf0f-5ea431c7de18 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:51.136717 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-17c8bf1b-5a46-4edc-bf0f-5ea431c7de18 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:51.144904 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-17c8bf1b-5a46-4edc-bf0f-5ea431c7de18 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1265 microversion: 2.1 time: 0.153795 Aug 18 12:31:51.145477 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 494/996] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:50 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:52.166115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-75c6c598-f0ac-438f-a1da-044e32cfef3f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:52.166730 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-75c6c598-f0ac-438f-a1da-044e32cfef3f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:52.173233 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75c6c598-f0ac-438f-a1da-044e32cfef3f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:52.173716 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75c6c598-f0ac-438f-a1da-044e32cfef3f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:52.174154 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75c6c598-f0ac-438f-a1da-044e32cfef3f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:52.174845 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75c6c598-f0ac-438f-a1da-044e32cfef3f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:52.175293 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75c6c598-f0ac-438f-a1da-044e32cfef3f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:52.175754 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-75c6c598-f0ac-438f-a1da-044e32cfef3f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:52.307616 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-75c6c598-f0ac-438f-a1da-044e32cfef3f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:52.316044 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-75c6c598-f0ac-438f-a1da-044e32cfef3f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1453 microversion: 2.1 time: 0.153811 Aug 18 12:31:52.316617 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 503/997] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:52 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:52.340637 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-bae2c80d-b67c-4b53-a933-5608031a86b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:52.341502 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-bae2c80d-b67c-4b53-a933-5608031a86b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:52.344902 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:52.349724 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bae2c80d-b67c-4b53-a933-5608031a86b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:52.350214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bae2c80d-b67c-4b53-a933-5608031a86b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:52.350660 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bae2c80d-b67c-4b53-a933-5608031a86b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:52.351444 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bae2c80d-b67c-4b53-a933-5608031a86b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:52.351905 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bae2c80d-b67c-4b53-a933-5608031a86b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:52.352340 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-bae2c80d-b67c-4b53-a933-5608031a86b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:52.484557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-bae2c80d-b67c-4b53-a933-5608031a86b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:52.492299 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-bae2c80d-b67c-4b53-a933-5608031a86b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1453 microversion: 2.1 time: 0.155514 Aug 18 12:31:52.492901 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 495/998] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:52 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:54.401280 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-d38341f2-07b1-4735-ae41-908133acf8c9 req-867e7a54-70c7-44d3-bd04-015e301e8442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4dd9b1-2d50-4008-9a96-c7cd11cea37c", "tag": "0ab0be7e-e022-4bcb-88d5-2fd5d954c6cd"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:54.406611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:54.411755 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-d38341f2-07b1-4735-ae41-908133acf8c9 req-867e7a54-70c7-44d3-bd04-015e301e8442 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:54.412228 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-d38341f2-07b1-4735-ae41-908133acf8c9 req-867e7a54-70c7-44d3-bd04-015e301e8442 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:54.412648 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-d38341f2-07b1-4735-ae41-908133acf8c9 req-867e7a54-70c7-44d3-bd04-015e301e8442 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:54.424360 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-d38341f2-07b1-4735-ae41-908133acf8c9 req-867e7a54-70c7-44d3-bd04-015e301e8442 service nova] Creating event network-changed:0ab0be7e-e022-4bcb-88d5-2fd5d954c6cd for instance 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c on hv-cinder-83602 Aug 18 12:31:54.429709 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-d38341f2-07b1-4735-ae41-908133acf8c9 req-867e7a54-70c7-44d3-bd04-015e301e8442 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031973 Aug 18 12:31:54.430318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 504/999] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:58.553738 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-25af96b2-5465-4295-b45e-236814ee4189 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:58.554287 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-25af96b2-5465-4295-b45e-236814ee4189 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:58.560486 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25af96b2-5465-4295-b45e-236814ee4189 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:58.560963 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25af96b2-5465-4295-b45e-236814ee4189 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:58.562046 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25af96b2-5465-4295-b45e-236814ee4189 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:58.562732 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25af96b2-5465-4295-b45e-236814ee4189 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:58.563175 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25af96b2-5465-4295-b45e-236814ee4189 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:58.563686 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-25af96b2-5465-4295-b45e-236814ee4189 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:58.566103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:58.587162 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-25af96b2-5465-4295-b45e-236814ee4189 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037399 Aug 18 12:31:58.587779 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 496/1000] 10.222.0.98 () {58 vars in 1248 bytes} [Thu Aug 18 12:31:58 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:00.186188 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-86412f6c-5c34-4dc8-8098-be23a0b83102 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "330cd44d-9378-4716-a1dd-ca5e8e0f01a3"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:00.189281 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-86412f6c-5c34-4dc8-8098-be23a0b83102 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:00.196946 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-86412f6c-5c34-4dc8-8098-be23a0b83102 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:00.197420 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-86412f6c-5c34-4dc8-8098-be23a0b83102 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:00.197848 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-86412f6c-5c34-4dc8-8098-be23a0b83102 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:00.199236 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-86412f6c-5c34-4dc8-8098-be23a0b83102 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:00.199801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-86412f6c-5c34-4dc8-8098-be23a0b83102 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:00.200279 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-86412f6c-5c34-4dc8-8098-be23a0b83102 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:00.203318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=75 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:00.943141 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-86412f6c-5c34-4dc8-8098-be23a0b83102 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761477 Aug 18 12:32:00.943860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 505/1001] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:32:00 2022] POST /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:08.471362 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "330cd44d-9378-4716-a1dd-ca5e8e0f01a3"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:08.473672 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:08.480680 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:08.481155 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:08.481582 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:08.482274 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:08.482721 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:08.483673 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:08.563361 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Invalid volume: volume 330cd44d-9378-4716-a1dd-ca5e8e0f01a3 is already attached to instances: 96c5df6e-7b55-47e0-b043-61faf4dac47b Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: POST /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-volume_attachments HTTP/1.1 Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 74 Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:32:08.565102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {"volumeAttachment": {"volumeId": "330cd44d-9378-4716-a1dd-ca5e8e0f01a3"}} Aug 18 12:32:08.566846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Invalid volume: volume 330cd44d-9378-4716-a1dd-ca5e8e0f01a3 is already attached to instances: 96c5df6e-7b55-47e0-b043-61faf4dac47b Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'server_id': '96c5df6e-7b55-47e0-b043-61faf4dac47b', 'body': {'volumeAttachment': {'volumeId': '330cd44d-9378-4716-a1dd-ca5e8e0f01a3'}}} Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 330cd44d-9378-4716-a1dd-ca5e8e0f01a3 is already attached to instances: 96c5df6e-7b55-47e0-b043-61faf4dac47b Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:08.567969 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 330cd44d-9378-4716-a1dd-ca5e8e0f01a3 is already attached to instances: 96c5df6e-7b55-47e0-b043-61faf4dac47b Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:32:08.569548 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:32:08.571331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:32:08.571331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:32:08.571331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:32:08.571331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 330cd44d-9378-4716-a1dd-ca5e8e0f01a3 is already attached to instances: 96c5df6e-7b55-47e0-b043-61faf4dac47b Aug 18 12:32:08.571331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:08.571331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 400 to user: Invalid volume: volume 330cd44d-9378-4716-a1dd-ca5e8e0f01a3 is already attached to instances: 96c5df6e-7b55-47e0-b043-61faf4dac47b {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:32:08.571331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a47b7ccf-93d6-42a4-8c6a-81b3c28efdfc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099601 Aug 18 12:32:08.571331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 497/1002] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:32:08 2022] POST /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 12:32:08.637630 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c97d02ce-8697-4437-93ea-be38534fc175 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:08.638218 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c97d02ce-8697-4437-93ea-be38534fc175 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:08.644431 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c97d02ce-8697-4437-93ea-be38534fc175 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:08.645600 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c97d02ce-8697-4437-93ea-be38534fc175 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:08.645600 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c97d02ce-8697-4437-93ea-be38534fc175 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:08.645996 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c97d02ce-8697-4437-93ea-be38534fc175 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:08.646442 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c97d02ce-8697-4437-93ea-be38534fc175 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:08.646862 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c97d02ce-8697-4437-93ea-be38534fc175 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:08.726879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-c97d02ce-8697-4437-93ea-be38534fc175 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lazy-loading 'services' on Instance uuid 96c5df6e-7b55-47e0-b043-61faf4dac47b {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:32:08.967170 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c97d02ce-8697-4437-93ea-be38534fc175 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-volume_attachments/330cd44d-9378-4716-a1dd-ca5e8e0f01a3" status: 202 len: 0 microversion: 2.1 time: 0.334212 Aug 18 12:32:08.968208 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 506/1003] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:32:08 2022] DELETE /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-volume_attachments/330cd44d-9378-4716-a1dd-ca5e8e0f01a3 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:32:08.977618 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e38458e8-5da6-452f-83f0-3f25d541cb10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:08.983894 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e38458e8-5da6-452f-83f0-3f25d541cb10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:08.987330 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e38458e8-5da6-452f-83f0-3f25d541cb10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:08.987858 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e38458e8-5da6-452f-83f0-3f25d541cb10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:08.988302 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e38458e8-5da6-452f-83f0-3f25d541cb10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:08.989009 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e38458e8-5da6-452f-83f0-3f25d541cb10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:08.989533 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e38458e8-5da6-452f-83f0-3f25d541cb10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:08.989901 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e38458e8-5da6-452f-83f0-3f25d541cb10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:09.020120 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e38458e8-5da6-452f-83f0-3f25d541cb10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 Aug 18 12:32:09.020660 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 498/1004] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:32:08 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:10.033897 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fb690b33-ae07-4b6c-9394-4f39ace2ec10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:10.036256 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fb690b33-ae07-4b6c-9394-4f39ace2ec10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:10.042735 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb690b33-ae07-4b6c-9394-4f39ace2ec10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:10.043245 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb690b33-ae07-4b6c-9394-4f39ace2ec10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:10.043719 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb690b33-ae07-4b6c-9394-4f39ace2ec10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:10.044415 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb690b33-ae07-4b6c-9394-4f39ace2ec10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:10.044894 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb690b33-ae07-4b6c-9394-4f39ace2ec10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:10.045319 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fb690b33-ae07-4b6c-9394-4f39ace2ec10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:10.074233 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fb690b33-ae07-4b6c-9394-4f39ace2ec10 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045638 Aug 18 12:32:10.074784 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 507/1005] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:32:10 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 12:32:10.138193 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-9f06a7c8-9077-4cd3-a9a2-d5a60919acbd tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:10.138826 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-9f06a7c8-9077-4cd3-a9a2-d5a60919acbd tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:10.145240 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9f06a7c8-9077-4cd3-a9a2-d5a60919acbd tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:10.145704 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9f06a7c8-9077-4cd3-a9a2-d5a60919acbd tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:10.146124 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9f06a7c8-9077-4cd3-a9a2-d5a60919acbd tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:10.146809 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9f06a7c8-9077-4cd3-a9a2-d5a60919acbd tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:10.147247 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9f06a7c8-9077-4cd3-a9a2-d5a60919acbd tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:10.147730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9f06a7c8-9077-4cd3-a9a2-d5a60919acbd tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:10.173557 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-9f06a7c8-9077-4cd3-a9a2-d5a60919acbd tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Going to try to terminate instance {{(pid=121244) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:32:10.495092 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-9f06a7c8-9077-4cd3-a9a2-d5a60919acbd tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 204 len: 0 microversion: 2.1 time: 0.360594 Aug 18 12:32:10.495801 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 499/1006] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:32:10 2022] DELETE /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:32:10.504713 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c1daafda-a009-40e0-af15-f448ee22b211 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:10.505321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c1daafda-a009-40e0-af15-f448ee22b211 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:10.511631 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c1daafda-a009-40e0-af15-f448ee22b211 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:10.513760 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c1daafda-a009-40e0-af15-f448ee22b211 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:10.513760 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c1daafda-a009-40e0-af15-f448ee22b211 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:10.513760 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c1daafda-a009-40e0-af15-f448ee22b211 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:10.513760 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c1daafda-a009-40e0-af15-f448ee22b211 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:10.514145 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c1daafda-a009-40e0-af15-f448ee22b211 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:10.646558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-c1daafda-a009-40e0-af15-f448ee22b211 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:10.654393 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c1daafda-a009-40e0-af15-f448ee22b211 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1682 microversion: 2.1 time: 0.153610 Aug 18 12:32:10.654979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 508/1007] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:10 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:11.675720 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-acad9dda-b5e3-4718-86e6-f5c4c00a7e75 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:11.676421 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-acad9dda-b5e3-4718-86e6-f5c4c00a7e75 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:11.682956 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-acad9dda-b5e3-4718-86e6-f5c4c00a7e75 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:11.683456 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-acad9dda-b5e3-4718-86e6-f5c4c00a7e75 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:11.683896 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-acad9dda-b5e3-4718-86e6-f5c4c00a7e75 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:11.684592 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-acad9dda-b5e3-4718-86e6-f5c4c00a7e75 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:11.685043 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-acad9dda-b5e3-4718-86e6-f5c4c00a7e75 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:11.685466 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-acad9dda-b5e3-4718-86e6-f5c4c00a7e75 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:11.818620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-acad9dda-b5e3-4718-86e6-f5c4c00a7e75 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:11.826254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-acad9dda-b5e3-4718-86e6-f5c4c00a7e75 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1682 microversion: 2.1 time: 0.154870 Aug 18 12:32:11.827428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 500/1008] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:11 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:12.184193 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:32:12.184784 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Thu Aug 18 12:32:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:32:12.849092 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-eeca5c7e-0107-426f-a23b-2203f18a7123 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:12.849796 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-eeca5c7e-0107-426f-a23b-2203f18a7123 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:12.857195 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eeca5c7e-0107-426f-a23b-2203f18a7123 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:12.857913 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eeca5c7e-0107-426f-a23b-2203f18a7123 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:12.858444 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eeca5c7e-0107-426f-a23b-2203f18a7123 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:12.859274 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eeca5c7e-0107-426f-a23b-2203f18a7123 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:12.859860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eeca5c7e-0107-426f-a23b-2203f18a7123 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:12.862214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-eeca5c7e-0107-426f-a23b-2203f18a7123 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:12.895402 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-afb85535-8736-41a4-9683-c456e81eee0f req-84693ffc-0add-44d0-aab5-2fd4b7e2726e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c5df6e-7b55-47e0-b043-61faf4dac47b", "name": "network-vif-deleted", "tag": "1f0b2751-be34-4be9-850c-b45247ed016d"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:12.913167 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-afb85535-8736-41a4-9683-c456e81eee0f req-84693ffc-0add-44d0-aab5-2fd4b7e2726e service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:12.914267 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-afb85535-8736-41a4-9683-c456e81eee0f req-84693ffc-0add-44d0-aab5-2fd4b7e2726e service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:12.914705 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-afb85535-8736-41a4-9683-c456e81eee0f req-84693ffc-0add-44d0-aab5-2fd4b7e2726e service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:12.927741 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-afb85535-8736-41a4-9683-c456e81eee0f req-84693ffc-0add-44d0-aab5-2fd4b7e2726e service nova] Creating event network-vif-deleted:1f0b2751-be34-4be9-850c-b45247ed016d for instance 96c5df6e-7b55-47e0-b043-61faf4dac47b on hv-cinder-83602 Aug 18 12:32:12.933088 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-eeca5c7e-0107-426f-a23b-2203f18a7123 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:12.934036 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-afb85535-8736-41a4-9683-c456e81eee0f req-84693ffc-0add-44d0-aab5-2fd4b7e2726e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042221 Aug 18 12:32:12.934826 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 501/1009] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:12.943764 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-eeca5c7e-0107-426f-a23b-2203f18a7123 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 200 len: 1615 microversion: 2.1 time: 0.098623 Aug 18 12:32:12.944567 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 509/1010] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:12 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 1615 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:13.966710 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:13.968646 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:13.975761 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:13.976254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:13.976709 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:13.977406 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:13.977904 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:13.978332 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:13.992979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b HTTP/1.1 Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:32:13.994664 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:32:13.996192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '96c5df6e-7b55-47e0-b043-61faf4dac47b'} Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:32:13.996971 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:32:13.998231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:14.000561 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:32:14.000561 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ecce1e90-26b2-4d23-ba9a-0cdf00f84572 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 404 len: 111 microversion: 2.1 time: 0.034378 Aug 18 12:32:14.000561 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 502/1011] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:13 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:32:14.005274 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a5abb33c-e7e1-4927-8879-d169166958d4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '.version_select at 0x7f37941e5c10>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:14.094421 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a5abb33c-e7e1-4927-8879-d169166958d4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1092103636" status: 202 len: 0 microversion: 2.1 time: 0.093122 Aug 18 12:32:14.094995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 510/1012] 10.222.0.98 () {58 vars in 1221 bytes} [Thu Aug 18 12:32:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1092103636 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:32:14.855219 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-095b5b62-8258-44f3-9b06-33c8b0230369 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: .version_select at 0x7f3787dffd30>, body: {"keypair": {"name": "tempest-keypair-1865028734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPptERz4l6vw/s+z2xHA/aN99PaFoFS/WoGvqk6J4PptV5owxcMmnsgOEhiTvU9nzz2aCKISD/d1wcUnBf4Z2UYVAXR6bhN6u40R83mG5C67n/DTno5ON6SG8mmhCKOlQ=="}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:14.871057 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-095b5b62-8258-44f3-9b06-33c8b0230369 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:32:14.875733 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-095b5b62-8258-44f3-9b06-33c8b0230369 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for user 27ed3f0ca7c44672a42aa774b02de88c and project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'key_pairs'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:32:14.959077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-095b5b62-8258-44f3-9b06-33c8b0230369 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107914 Aug 18 12:32:14.959707 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 503/1013] 10.222.0.98 () {60 vars in 1159 bytes} [Thu Aug 18 12:32:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:17.111749 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1044837932", "imageRef": "b4469587-c638-4ec5-b89d-ad8ca74a3e22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e16b12d6-9788-4022-91a7-d06421bd0ecc"}], "security_groups": [{"name": "tempest-securitygroup--751497066"}], "key_name": "tempest-keypair-1865028734", "user_data": "}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:17.219691 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.network.neutron [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] validate_networks() for [('e16b12d6-9788-4022-91a7-d06421bd0ecc', None, None, None, None, None)] {{(pid=121245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:32:17.585497 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Flavor limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:32:17.585924 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Image limits 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:32:17.586426 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Flavor pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:32:17.586834 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Image pref 0:0:0 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:32:17.587275 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.virt.hardware [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:32:17.596879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:17.597357 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:17.597790 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:17.598513 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:17.598964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:17.599388 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:17.616534 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:32:17.620498 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.quota [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Getting quotas for user 27ed3f0ca7c44672a42aa774b02de88c and project 86b496e7df3e4e5d8781c49101c619c2. Resources: {'ram', 'instances', 'cores'} {{(pid=121245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:32:17.631705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Going to run 1 instances... {{(pid=121245) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:32:17.634077 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4469587-c638-4ec5-b89d-ad8ca74a3e22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:32:17.822765 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-82b87928-22ad-4773-be7a-b4caa98aef58 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.716115 Aug 18 12:32:17.823430 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 511/1014] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:32:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:32:17.835611 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e011b2f8-f3be-4374-91a7-2b15550005da tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:17.836226 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e011b2f8-f3be-4374-91a7-2b15550005da tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:17.897270 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e011b2f8-f3be-4374-91a7-2b15550005da tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:17.903654 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e011b2f8-f3be-4374-91a7-2b15550005da tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1242 microversion: 2.1 time: 0.073152 Aug 18 12:32:17.904281 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 504/1015] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:17 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:18.926147 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fe5e69f3-7ab1-447c-b057-efc4a3c260f3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:18.926745 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fe5e69f3-7ab1-447c-b057-efc4a3c260f3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:18.933197 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe5e69f3-7ab1-447c-b057-efc4a3c260f3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:18.933681 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe5e69f3-7ab1-447c-b057-efc4a3c260f3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:18.934177 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe5e69f3-7ab1-447c-b057-efc4a3c260f3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:18.934888 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe5e69f3-7ab1-447c-b057-efc4a3c260f3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:18.935350 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe5e69f3-7ab1-447c-b057-efc4a3c260f3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:18.935801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fe5e69f3-7ab1-447c-b057-efc4a3c260f3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:19.009805 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fe5e69f3-7ab1-447c-b057-efc4a3c260f3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:19.017306 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fe5e69f3-7ab1-447c-b057-efc4a3c260f3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1246 microversion: 2.1 time: 0.096175 Aug 18 12:32:19.017919 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 512/1016] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:18 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:20.037684 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-cc2001d2-69d7-4076-9ab2-54d9e32604a9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:20.038279 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-cc2001d2-69d7-4076-9ab2-54d9e32604a9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:20.045551 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc2001d2-69d7-4076-9ab2-54d9e32604a9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:20.046075 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc2001d2-69d7-4076-9ab2-54d9e32604a9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:20.046519 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc2001d2-69d7-4076-9ab2-54d9e32604a9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:20.047777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc2001d2-69d7-4076-9ab2-54d9e32604a9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:20.048240 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc2001d2-69d7-4076-9ab2-54d9e32604a9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:20.048670 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cc2001d2-69d7-4076-9ab2-54d9e32604a9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:20.119041 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-cc2001d2-69d7-4076-9ab2-54d9e32604a9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:20.128162 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-cc2001d2-69d7-4076-9ab2-54d9e32604a9 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1312 microversion: 2.1 time: 0.094457 Aug 18 12:32:20.128726 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 505/1017] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:20 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:21.149248 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-db159073-a6b7-45a6-996a-536f3c9d72cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:21.151018 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-db159073-a6b7-45a6-996a-536f3c9d72cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:21.166208 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db159073-a6b7-45a6-996a-536f3c9d72cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:21.166720 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db159073-a6b7-45a6-996a-536f3c9d72cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:21.167168 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db159073-a6b7-45a6-996a-536f3c9d72cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:21.167940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db159073-a6b7-45a6-996a-536f3c9d72cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:21.168397 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db159073-a6b7-45a6-996a-536f3c9d72cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:21.168822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-db159073-a6b7-45a6-996a-536f3c9d72cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:21.301486 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-db159073-a6b7-45a6-996a-536f3c9d72cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:21.309099 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-db159073-a6b7-45a6-996a-536f3c9d72cc tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1367 microversion: 2.1 time: 0.163697 Aug 18 12:32:21.309671 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 513/1018] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:21 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:21.813765 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-9b6f50f1-bb01-4ed1-8fae-567d5f343890 req-e2c8b150-16a2-4e16-a73c-d6ce5050de16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3117e783-eb44-4f04-bc13-e23f98d63bc0", "tag": "88c23b87-c71e-45be-bcab-fd21fccfc26e"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:21.823307 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-9b6f50f1-bb01-4ed1-8fae-567d5f343890 req-e2c8b150-16a2-4e16-a73c-d6ce5050de16 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:21.823809 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-9b6f50f1-bb01-4ed1-8fae-567d5f343890 req-e2c8b150-16a2-4e16-a73c-d6ce5050de16 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:21.824231 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-9b6f50f1-bb01-4ed1-8fae-567d5f343890 req-e2c8b150-16a2-4e16-a73c-d6ce5050de16 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:21.835013 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-9b6f50f1-bb01-4ed1-8fae-567d5f343890 req-e2c8b150-16a2-4e16-a73c-d6ce5050de16 service nova] Creating event network-changed:88c23b87-c71e-45be-bcab-fd21fccfc26e for instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 on hv-cinder-83602 Aug 18 12:32:21.840331 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-9b6f50f1-bb01-4ed1-8fae-567d5f343890 req-e2c8b150-16a2-4e16-a73c-d6ce5050de16 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030544 Aug 18 12:32:21.840895 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 506/1019] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:22.332030 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-751846f0-5fac-4fb2-9588-0727012f3595 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:22.333064 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-751846f0-5fac-4fb2-9588-0727012f3595 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:22.340070 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-751846f0-5fac-4fb2-9588-0727012f3595 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:22.340540 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-751846f0-5fac-4fb2-9588-0727012f3595 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:22.340965 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-751846f0-5fac-4fb2-9588-0727012f3595 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:22.341648 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-751846f0-5fac-4fb2-9588-0727012f3595 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:22.342091 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-751846f0-5fac-4fb2-9588-0727012f3595 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:22.342507 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-751846f0-5fac-4fb2-9588-0727012f3595 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:22.476705 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-751846f0-5fac-4fb2-9588-0727012f3595 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:22.484169 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-751846f0-5fac-4fb2-9588-0727012f3595 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1367 microversion: 2.1 time: 0.157606 Aug 18 12:32:22.484734 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 514/1020] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:22 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:23.505991 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d3050847-d555-4ac8-b9a6-6793a3fcfc48 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:23.506681 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d3050847-d555-4ac8-b9a6-6793a3fcfc48 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:23.508673 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:23.513536 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3050847-d555-4ac8-b9a6-6793a3fcfc48 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:23.514015 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3050847-d555-4ac8-b9a6-6793a3fcfc48 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:23.514445 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3050847-d555-4ac8-b9a6-6793a3fcfc48 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:23.515133 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3050847-d555-4ac8-b9a6-6793a3fcfc48 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:23.515607 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3050847-d555-4ac8-b9a6-6793a3fcfc48 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:23.516679 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3050847-d555-4ac8-b9a6-6793a3fcfc48 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:23.651865 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-d3050847-d555-4ac8-b9a6-6793a3fcfc48 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:23.659303 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d3050847-d555-4ac8-b9a6-6793a3fcfc48 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1367 microversion: 2.1 time: 0.158107 Aug 18 12:32:23.659968 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 507/1021] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:23 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:24.679348 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-b3a7a835-4653-422f-95d8-480bd11365f2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:24.679985 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-b3a7a835-4653-422f-95d8-480bd11365f2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:24.687059 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3a7a835-4653-422f-95d8-480bd11365f2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:24.687604 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3a7a835-4653-422f-95d8-480bd11365f2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:24.688040 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3a7a835-4653-422f-95d8-480bd11365f2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:24.688727 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3a7a835-4653-422f-95d8-480bd11365f2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:24.689177 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3a7a835-4653-422f-95d8-480bd11365f2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:24.689602 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-b3a7a835-4653-422f-95d8-480bd11365f2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:24.817665 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-b3a7a835-4653-422f-95d8-480bd11365f2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:24.825058 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-b3a7a835-4653-422f-95d8-480bd11365f2 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1367 microversion: 2.1 time: 0.149715 Aug 18 12:32:24.825615 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 515/1022] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:24 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:25.616774 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-567d40f6-d157-401a-a944-47e6c9268152 req-01893727-aa3e-4d37-a4fd-fcfcdf2ebad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3117e783-eb44-4f04-bc13-e23f98d63bc0", "name": "network-vif-plugged", "status": "completed", "tag": "88c23b87-c71e-45be-bcab-fd21fccfc26e"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:25.627163 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-567d40f6-d157-401a-a944-47e6c9268152 req-01893727-aa3e-4d37-a4fd-fcfcdf2ebad1 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:25.627674 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-567d40f6-d157-401a-a944-47e6c9268152 req-01893727-aa3e-4d37-a4fd-fcfcdf2ebad1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:25.628093 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-567d40f6-d157-401a-a944-47e6c9268152 req-01893727-aa3e-4d37-a4fd-fcfcdf2ebad1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:25.638845 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-567d40f6-d157-401a-a944-47e6c9268152 req-01893727-aa3e-4d37-a4fd-fcfcdf2ebad1 service nova] Creating event network-vif-plugged:88c23b87-c71e-45be-bcab-fd21fccfc26e for instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 on hv-cinder-83602 Aug 18 12:32:25.643573 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-567d40f6-d157-401a-a944-47e6c9268152 req-01893727-aa3e-4d37-a4fd-fcfcdf2ebad1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031018 Aug 18 12:32:25.644220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 508/1023] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:25.846860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3b087761-260a-48a8-8350-418a798b992d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:25.847405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3b087761-260a-48a8-8350-418a798b992d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:25.854024 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b087761-260a-48a8-8350-418a798b992d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:25.854504 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b087761-260a-48a8-8350-418a798b992d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:25.854955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b087761-260a-48a8-8350-418a798b992d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:25.855719 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b087761-260a-48a8-8350-418a798b992d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:25.856168 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b087761-260a-48a8-8350-418a798b992d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:25.856588 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3b087761-260a-48a8-8350-418a798b992d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:26.001037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3b087761-260a-48a8-8350-418a798b992d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:26.009465 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3b087761-260a-48a8-8350-418a798b992d tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1367 microversion: 2.1 time: 0.167117 Aug 18 12:32:26.010066 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 516/1024] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:25 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:27.031076 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-461b9687-5809-4c83-ac25-cb4619c1cdd5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:27.032466 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-461b9687-5809-4c83-ac25-cb4619c1cdd5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:27.038890 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-461b9687-5809-4c83-ac25-cb4619c1cdd5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:27.039373 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-461b9687-5809-4c83-ac25-cb4619c1cdd5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:27.039839 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-461b9687-5809-4c83-ac25-cb4619c1cdd5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:27.040650 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-461b9687-5809-4c83-ac25-cb4619c1cdd5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:27.041103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-461b9687-5809-4c83-ac25-cb4619c1cdd5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:27.041526 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-461b9687-5809-4c83-ac25-cb4619c1cdd5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:27.176914 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-461b9687-5809-4c83-ac25-cb4619c1cdd5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:27.184540 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-461b9687-5809-4c83-ac25-cb4619c1cdd5 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1367 microversion: 2.1 time: 0.158149 Aug 18 12:32:27.185117 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 509/1025] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:27 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:28.206276 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fcf9230b-ccc6-4284-8fd8-25399a71d151 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:28.206801 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fcf9230b-ccc6-4284-8fd8-25399a71d151 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:28.209247 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:28.209912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=6 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:28.214947 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf9230b-ccc6-4284-8fd8-25399a71d151 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:28.215448 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf9230b-ccc6-4284-8fd8-25399a71d151 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:28.215888 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf9230b-ccc6-4284-8fd8-25399a71d151 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:28.216578 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf9230b-ccc6-4284-8fd8-25399a71d151 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:28.217109 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf9230b-ccc6-4284-8fd8-25399a71d151 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:28.217546 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fcf9230b-ccc6-4284-8fd8-25399a71d151 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:28.346915 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-fcf9230b-ccc6-4284-8fd8-25399a71d151 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:28.354489 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fcf9230b-ccc6-4284-8fd8-25399a71d151 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1558 microversion: 2.1 time: 0.152239 Aug 18 12:32:28.355060 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 517/1026] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:28 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:28.375677 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ad399a0f-1b81-4b81-a066-d945b5395cf4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:28.376260 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ad399a0f-1b81-4b81-a066-d945b5395cf4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:28.378302 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=6 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:28.384960 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad399a0f-1b81-4b81-a066-d945b5395cf4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:28.385465 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad399a0f-1b81-4b81-a066-d945b5395cf4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:28.385907 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad399a0f-1b81-4b81-a066-d945b5395cf4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:28.388809 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad399a0f-1b81-4b81-a066-d945b5395cf4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:28.389296 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad399a0f-1b81-4b81-a066-d945b5395cf4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:28.389734 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ad399a0f-1b81-4b81-a066-d945b5395cf4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:28.468330 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ad399a0f-1b81-4b81-a066-d945b5395cf4 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097453 Aug 18 12:32:28.469280 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 510/1027] 10.222.0.98 () {58 vars in 1275 bytes} [Thu Aug 18 12:32:28 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:29.460864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-d8eff874-9143-4633-b6ff-a9998501809e req-18fe03ad-e1ef-4e11-8fd0-218b41a6c0ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3117e783-eb44-4f04-bc13-e23f98d63bc0", "tag": "88c23b87-c71e-45be-bcab-fd21fccfc26e"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:29.470945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-d8eff874-9143-4633-b6ff-a9998501809e req-18fe03ad-e1ef-4e11-8fd0-218b41a6c0ed service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:29.471439 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-d8eff874-9143-4633-b6ff-a9998501809e req-18fe03ad-e1ef-4e11-8fd0-218b41a6c0ed service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:29.471868 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-d8eff874-9143-4633-b6ff-a9998501809e req-18fe03ad-e1ef-4e11-8fd0-218b41a6c0ed service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:29.484587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-d8eff874-9143-4633-b6ff-a9998501809e req-18fe03ad-e1ef-4e11-8fd0-218b41a6c0ed service nova] Creating event network-changed:88c23b87-c71e-45be-bcab-fd21fccfc26e for instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 on hv-cinder-83602 Aug 18 12:32:29.488007 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-d8eff874-9143-4633-b6ff-a9998501809e req-18fe03ad-e1ef-4e11-8fd0-218b41a6c0ed service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030749 Aug 18 12:32:29.489147 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 518/1028] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:46.032365 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=7 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:46.034049 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:46.042008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-7454977b-8caa-4c63-8542-23b781026c46 req-11322ee0-81e9-4eba-86d3-0b617d9dcc57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26fb4ea-80d1-405d-b693-2fe9cbe2f45c", "tag": "dc009460-8a64-46d7-ba37-594be57137d0"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:46.042620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-be0b1b3e-ff8a-402b-bbf3-e977d52b1bb5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:46.042733 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-be0b1b3e-ff8a-402b-bbf3-e977d52b1bb5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:46.047966 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:46.048908 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:46.050402 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0b1b3e-ff8a-402b-bbf3-e977d52b1bb5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:46.051105 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0b1b3e-ff8a-402b-bbf3-e977d52b1bb5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:46.051570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0b1b3e-ff8a-402b-bbf3-e977d52b1bb5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:46.052470 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0b1b3e-ff8a-402b-bbf3-e977d52b1bb5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:46.052926 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0b1b3e-ff8a-402b-bbf3-e977d52b1bb5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:46.053352 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-be0b1b3e-ff8a-402b-bbf3-e977d52b1bb5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:46.055671 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-7454977b-8caa-4c63-8542-23b781026c46 req-11322ee0-81e9-4eba-86d3-0b617d9dcc57 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:46.056156 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-7454977b-8caa-4c63-8542-23b781026c46 req-11322ee0-81e9-4eba-86d3-0b617d9dcc57 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:46.056597 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-7454977b-8caa-4c63-8542-23b781026c46 req-11322ee0-81e9-4eba-86d3-0b617d9dcc57 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:46.068706 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-7454977b-8caa-4c63-8542-23b781026c46 req-11322ee0-81e9-4eba-86d3-0b617d9dcc57 service nova] Creating event network-changed:dc009460-8a64-46d7-ba37-594be57137d0 for instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c on hv-cinder-83602 Aug 18 12:32:46.074473 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-7454977b-8caa-4c63-8542-23b781026c46 req-11322ee0-81e9-4eba-86d3-0b617d9dcc57 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036898 Aug 18 12:32:46.075368 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 519/1029] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:46.081705 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-be0b1b3e-ff8a-402b-bbf3-e977d52b1bb5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Going to try to terminate instance {{(pid=121244) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:32:46.364988 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-be0b1b3e-ff8a-402b-bbf3-e977d52b1bb5 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 204 len: 0 microversion: 2.1 time: 0.333627 Aug 18 12:32:46.368735 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 511/1030] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:32:46 2022] DELETE /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:32:46.376757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-84d18964-3219-44d7-979e-3acfd4dfa6a7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:46.378051 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-84d18964-3219-44d7-979e-3acfd4dfa6a7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:46.384725 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84d18964-3219-44d7-979e-3acfd4dfa6a7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:46.385214 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84d18964-3219-44d7-979e-3acfd4dfa6a7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:46.385654 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84d18964-3219-44d7-979e-3acfd4dfa6a7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:46.386383 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84d18964-3219-44d7-979e-3acfd4dfa6a7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:46.386829 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84d18964-3219-44d7-979e-3acfd4dfa6a7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:46.387241 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-84d18964-3219-44d7-979e-3acfd4dfa6a7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:46.537293 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-84d18964-3219-44d7-979e-3acfd4dfa6a7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:46.544949 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-84d18964-3219-44d7-979e-3acfd4dfa6a7 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.173642 Aug 18 12:32:46.545508 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 520/1031] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:46 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:47.567638 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-9d915fd4-af5a-4199-9363-b1e861d28edf tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:47.568358 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-9d915fd4-af5a-4199-9363-b1e861d28edf tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:47.575375 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9d915fd4-af5a-4199-9363-b1e861d28edf tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:47.575672 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9d915fd4-af5a-4199-9363-b1e861d28edf tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:47.576107 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9d915fd4-af5a-4199-9363-b1e861d28edf tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:47.576814 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9d915fd4-af5a-4199-9363-b1e861d28edf tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:47.577288 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9d915fd4-af5a-4199-9363-b1e861d28edf tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:47.577701 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-9d915fd4-af5a-4199-9363-b1e861d28edf tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:47.710898 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-9d915fd4-af5a-4199-9363-b1e861d28edf tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:47.719504 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-9d915fd4-af5a-4199-9363-b1e861d28edf tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1568 microversion: 2.1 time: 0.156581 Aug 18 12:32:47.720285 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 512/1032] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:47 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:48.574039 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-67fe3e1b-2a96-424a-84bd-4980f75f4a6a req-8e80e2f5-967e-49fc-9d8d-4f03722d9144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26fb4ea-80d1-405d-b693-2fe9cbe2f45c", "name": "network-vif-deleted", "tag": "dc009460-8a64-46d7-ba37-594be57137d0"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:48.584758 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-67fe3e1b-2a96-424a-84bd-4980f75f4a6a req-8e80e2f5-967e-49fc-9d8d-4f03722d9144 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:48.585242 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-67fe3e1b-2a96-424a-84bd-4980f75f4a6a req-8e80e2f5-967e-49fc-9d8d-4f03722d9144 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:48.585666 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-67fe3e1b-2a96-424a-84bd-4980f75f4a6a req-8e80e2f5-967e-49fc-9d8d-4f03722d9144 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:48.597853 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-67fe3e1b-2a96-424a-84bd-4980f75f4a6a req-8e80e2f5-967e-49fc-9d8d-4f03722d9144 service nova] Creating event network-vif-deleted:dc009460-8a64-46d7-ba37-594be57137d0 for instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c on hv-cinder-83602 Aug 18 12:32:48.602969 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-67fe3e1b-2a96-424a-84bd-4980f75f4a6a req-8e80e2f5-967e-49fc-9d8d-4f03722d9144 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033233 Aug 18 12:32:48.603928 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 521/1033] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:48.741507 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ae7f7c42-9014-46a5-9184-aac336a3117a tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:48.742077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ae7f7c42-9014-46a5-9184-aac336a3117a tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:48.748643 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae7f7c42-9014-46a5-9184-aac336a3117a tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:48.749127 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae7f7c42-9014-46a5-9184-aac336a3117a tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:48.749564 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae7f7c42-9014-46a5-9184-aac336a3117a tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:48.750256 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae7f7c42-9014-46a5-9184-aac336a3117a tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:48.750733 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae7f7c42-9014-46a5-9184-aac336a3117a tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:48.751156 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ae7f7c42-9014-46a5-9184-aac336a3117a tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:48.814633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ae7f7c42-9014-46a5-9184-aac336a3117a tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:48.822072 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ae7f7c42-9014-46a5-9184-aac336a3117a tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1219 microversion: 2.1 time: 0.084575 Aug 18 12:32:48.822630 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 513/1034] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:48 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:49.851365 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:49.852295 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:49.858865 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:49.859352 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:49.859813 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:49.860510 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:49.861042 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:49.861464 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:49.897895 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:49.898380 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:49.898812 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:49.899901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.objects.instance [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lazy-loading 'fault' on Instance uuid b26fb4ea-80d1-405d-b693-2fe9cbe2f45c {{(pid=121245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:32:49.941315 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e664528e3e33426aae2d47640b57e079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453baf77e6744eb8f001a1c1bb9d0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:49.949046 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f23dd36a-e056-4add-bf1f-8936f981fdb1 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 200 len: 1224 microversion: 2.1 time: 0.106829 Aug 18 12:32:49.949537 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 522/1035] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:49 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:50.970165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:50.970767 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] [instance: b26fb4ea-80d1-405d-b693-2fe9cbe2f45c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:50.977173 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:50.977644 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:50.978073 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:50.978754 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:50.979210 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:50.979703 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:50.993169 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] HTTP exception thrown: Instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c could not be found. Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Request method failure captured: Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c HTTP/1.1 Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jBHLaaOfTcUlwyi2nTzYlxG_m2hdCvT6MDqHUFSOb68BDebhUsoz8PvJvEzQgBmcAd3R_SaGyYuECfgbeHoSiXPjwCbAYMdn7yNr5MvajF_rm1d7_EjmGqjSwWvCamZ8WZdqiaiXtsANoM7W2ASnduItKgQEDmyV9_86FoZO7n0p_M Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: e453baf77e6744eb8f001a1c1bb9d0d1 Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-TestShelveInstance-1749639883 Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:32:50.994795 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e453baf77e6744eb8f001a1c1bb9d0d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e453baf77e6744eb8f001a1c1bb9d0d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e453baf77e6744eb8f001a1c1bb9d0d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e453baf77e6744eb8f001a1c1bb9d0d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-TestShelveInstance-1749639883 Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: e453baf77e6744eb8f001a1c1bb9d0d1 Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-TestShelveInstance-1749639883 Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-TestShelveInstance-1749639883-project Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: e664528e3e33426aae2d47640b57e079 Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-TestShelveInstance-1749639883-project Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c could not be found. Aug 18 12:32:50.996691 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': 'b26fb4ea-80d1-405d-b693-2fe9cbe2f45c'} Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c could not be found. Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:32:50.997715 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c could not be found. Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c could not be found. Aug 18 12:32:50.999326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:32:51.000834 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Returning 404 to user: Instance b26fb4ea-80d1-405d-b693-2fe9cbe2f45c could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:32:51.000834 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-fdc4d0ce-12df-4e2b-9711-a750a8ef6661 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c" status: 404 len: 111 microversion: 2.1 time: 0.030013 Aug 18 12:32:51.000834 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 514/1036] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:50 2022] GET /compute/v2.1/servers/b26fb4ea-80d1-405d-b693-2fe9cbe2f45c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:32:51.224481 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4328c879-37fb-4909-9903-54cf14c27846 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] Calling method '.version_select at 0x7f3787fc6ee0>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:51.307195 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4328c879-37fb-4909-9903-54cf14c27846 tempest-TestShelveInstance-1749639883 tempest-TestShelveInstance-1749639883-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1244825414" status: 202 len: 0 microversion: 2.1 time: 0.087125 Aug 18 12:32:51.307974 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 523/1037] 10.222.0.98 () {58 vars in 1254 bytes} [Thu Aug 18 12:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1244825414 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:33:05.311695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ab9fa734-cd65-4ce3-ab55-a16ae55ad3be tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:05.312326 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ab9fa734-cd65-4ce3-ab55-a16ae55ad3be tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:05.314258 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:05.314899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:05.319505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab9fa734-cd65-4ce3-ab55-a16ae55ad3be tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:05.319986 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab9fa734-cd65-4ce3-ab55-a16ae55ad3be tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:05.320415 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab9fa734-cd65-4ce3-ab55-a16ae55ad3be tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:05.321093 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab9fa734-cd65-4ce3-ab55-a16ae55ad3be tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:05.321537 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab9fa734-cd65-4ce3-ab55-a16ae55ad3be tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:05.321955 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ab9fa734-cd65-4ce3-ab55-a16ae55ad3be tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:05.345471 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ab9fa734-cd65-4ce3-ab55-a16ae55ad3be tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/ips" status: 200 len: 151 microversion: 2.1 time: 0.037805 Aug 18 12:33:05.346038 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 515/1038] 10.222.0.98 () {58 vars in 1248 bytes} [Thu Aug 18 12:33:05 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:07.186465 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=18 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:07.187231 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:07.191527 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-783f217c-60c1-4179-b513-0b16108b6fef tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30639e54-3511-4d67-afc2-b23931113aff"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:07.193988 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-783f217c-60c1-4179-b513-0b16108b6fef tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:07.201353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-783f217c-60c1-4179-b513-0b16108b6fef tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:07.202864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-783f217c-60c1-4179-b513-0b16108b6fef tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:07.202864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-783f217c-60c1-4179-b513-0b16108b6fef tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:07.203133 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-783f217c-60c1-4179-b513-0b16108b6fef tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:07.203443 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-783f217c-60c1-4179-b513-0b16108b6fef tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:07.203891 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-783f217c-60c1-4179-b513-0b16108b6fef tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:07.876936 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-783f217c-60c1-4179-b513-0b16108b6fef tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "POST /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691783 Aug 18 12:33:07.877479 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 524/1039] 10.222.0.98 () {60 vars in 1323 bytes} [Thu Aug 18 12:33:07 2022] POST /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:15.490666 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3089d8c3-cd41-437c-ab39-ad297539d326 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:15.491311 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3089d8c3-cd41-437c-ab39-ad297539d326 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:15.499429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3089d8c3-cd41-437c-ab39-ad297539d326 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:15.499920 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3089d8c3-cd41-437c-ab39-ad297539d326 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:15.500354 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3089d8c3-cd41-437c-ab39-ad297539d326 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:15.501048 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3089d8c3-cd41-437c-ab39-ad297539d326 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:15.501500 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3089d8c3-cd41-437c-ab39-ad297539d326 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:15.501925 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3089d8c3-cd41-437c-ab39-ad297539d326 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:15.582938 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-3089d8c3-cd41-437c-ab39-ad297539d326 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lazy-loading 'services' on Instance uuid 3117e783-eb44-4f04-bc13-e23f98d63bc0 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:33:15.857681 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3089d8c3-cd41-437c-ab39-ad297539d326 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/os-volume_attachments/30639e54-3511-4d67-afc2-b23931113aff" status: 202 len: 0 microversion: 2.1 time: 0.370770 Aug 18 12:33:15.858349 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 516/1040] 10.222.0.98 () {58 vars in 1416 bytes} [Thu Aug 18 12:33:15 2022] DELETE /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/os-volume_attachments/30639e54-3511-4d67-afc2-b23931113aff => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:33:15.867672 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5f3ce704-6a17-4dbf-b419-55beecd5baad tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:15.870033 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-5f3ce704-6a17-4dbf-b419-55beecd5baad tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:15.876368 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5f3ce704-6a17-4dbf-b419-55beecd5baad tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:15.876853 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5f3ce704-6a17-4dbf-b419-55beecd5baad tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:15.877289 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5f3ce704-6a17-4dbf-b419-55beecd5baad tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:15.877985 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5f3ce704-6a17-4dbf-b419-55beecd5baad tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:15.878438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5f3ce704-6a17-4dbf-b419-55beecd5baad tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:15.878860 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-5f3ce704-6a17-4dbf-b419-55beecd5baad tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:15.909029 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5f3ce704-6a17-4dbf-b419-55beecd5baad tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046113 Aug 18 12:33:15.909587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 525/1041] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:33:15 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:16.924979 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-d3326b01-ae62-4d83-934d-715cb6c54eed tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:16.927458 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-d3326b01-ae62-4d83-934d-715cb6c54eed tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:16.937104 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3326b01-ae62-4d83-934d-715cb6c54eed tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:16.937500 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3326b01-ae62-4d83-934d-715cb6c54eed tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:16.937931 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3326b01-ae62-4d83-934d-715cb6c54eed tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:16.938690 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3326b01-ae62-4d83-934d-715cb6c54eed tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:16.939061 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3326b01-ae62-4d83-934d-715cb6c54eed tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:16.939509 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-d3326b01-ae62-4d83-934d-715cb6c54eed tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:16.971060 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-d3326b01-ae62-4d83-934d-715cb6c54eed tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052850 Aug 18 12:33:16.971648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 517/1042] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Aug 18 12:33:16 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 12:33:17.033475 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c28095c4-12b0-4bae-84f3-b62c36c1a348 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:17.033975 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c28095c4-12b0-4bae-84f3-b62c36c1a348 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:17.040404 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c28095c4-12b0-4bae-84f3-b62c36c1a348 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:17.040886 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c28095c4-12b0-4bae-84f3-b62c36c1a348 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:17.041357 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c28095c4-12b0-4bae-84f3-b62c36c1a348 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:17.042048 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c28095c4-12b0-4bae-84f3-b62c36c1a348 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:17.042498 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c28095c4-12b0-4bae-84f3-b62c36c1a348 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:17.042934 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-c28095c4-12b0-4bae-84f3-b62c36c1a348 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:17.068182 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-c28095c4-12b0-4bae-84f3-b62c36c1a348 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:33:17.366971 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c28095c4-12b0-4bae-84f3-b62c36c1a348 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 204 len: 0 microversion: 2.1 time: 0.337121 Aug 18 12:33:17.367633 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 526/1043] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:33:17 2022] DELETE /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:33:17.376421 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b045412d-2a8e-4392-9263-f2bca2cd350c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:17.377018 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-b045412d-2a8e-4392-9263-f2bca2cd350c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:17.383737 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b045412d-2a8e-4392-9263-f2bca2cd350c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:17.386777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b045412d-2a8e-4392-9263-f2bca2cd350c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:17.386777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b045412d-2a8e-4392-9263-f2bca2cd350c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:17.386777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b045412d-2a8e-4392-9263-f2bca2cd350c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:17.386777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b045412d-2a8e-4392-9263-f2bca2cd350c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:17.387154 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-b045412d-2a8e-4392-9263-f2bca2cd350c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:17.514410 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-b045412d-2a8e-4392-9263-f2bca2cd350c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:17.522080 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b045412d-2a8e-4392-9263-f2bca2cd350c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1683 microversion: 2.1 time: 0.149529 Aug 18 12:33:17.522648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 518/1044] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:17 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:18.545021 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4998b2cc-9535-45fb-9ac0-1494f5e07414 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:18.545715 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-4998b2cc-9535-45fb-9ac0-1494f5e07414 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:18.552102 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4998b2cc-9535-45fb-9ac0-1494f5e07414 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:18.552579 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4998b2cc-9535-45fb-9ac0-1494f5e07414 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:18.553009 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4998b2cc-9535-45fb-9ac0-1494f5e07414 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:18.553697 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4998b2cc-9535-45fb-9ac0-1494f5e07414 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:18.554142 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4998b2cc-9535-45fb-9ac0-1494f5e07414 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:18.554569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4998b2cc-9535-45fb-9ac0-1494f5e07414 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:18.688836 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-4998b2cc-9535-45fb-9ac0-1494f5e07414 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:18.697336 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4998b2cc-9535-45fb-9ac0-1494f5e07414 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1683 microversion: 2.1 time: 0.156514 Aug 18 12:33:18.697907 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 527/1045] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:18 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:19.718652 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-06c1cb9e-4d05-4cd1-a47e-4bf497d48b9c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:19.719229 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-06c1cb9e-4d05-4cd1-a47e-4bf497d48b9c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:19.726300 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-06c1cb9e-4d05-4cd1-a47e-4bf497d48b9c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:19.727294 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-06c1cb9e-4d05-4cd1-a47e-4bf497d48b9c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:19.727756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-06c1cb9e-4d05-4cd1-a47e-4bf497d48b9c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:19.728470 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-06c1cb9e-4d05-4cd1-a47e-4bf497d48b9c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:19.728930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-06c1cb9e-4d05-4cd1-a47e-4bf497d48b9c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:19.729354 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-06c1cb9e-4d05-4cd1-a47e-4bf497d48b9c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:19.849846 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-06c1cb9e-4d05-4cd1-a47e-4bf497d48b9c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:19.859143 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-06c1cb9e-4d05-4cd1-a47e-4bf497d48b9c tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1616 microversion: 2.1 time: 0.144392 Aug 18 12:33:19.859837 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 519/1046] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:19 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1616 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:20.027532 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-68bd9101-4747-4bcb-9e52-f09f723c5b74 req-1666607c-fa9d-4546-9835-c5b4dd89cada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3117e783-eb44-4f04-bc13-e23f98d63bc0", "name": "network-vif-deleted", "tag": "88c23b87-c71e-45be-bcab-fd21fccfc26e"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:20.038242 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-68bd9101-4747-4bcb-9e52-f09f723c5b74 req-1666607c-fa9d-4546-9835-c5b4dd89cada service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:20.041732 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-68bd9101-4747-4bcb-9e52-f09f723c5b74 req-1666607c-fa9d-4546-9835-c5b4dd89cada service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:20.041732 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-68bd9101-4747-4bcb-9e52-f09f723c5b74 req-1666607c-fa9d-4546-9835-c5b4dd89cada service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:20.051587 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-68bd9101-4747-4bcb-9e52-f09f723c5b74 req-1666607c-fa9d-4546-9835-c5b4dd89cada service nova] Creating event network-vif-deleted:88c23b87-c71e-45be-bcab-fd21fccfc26e for instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 on hv-cinder-83602 Aug 18 12:33:20.056937 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-68bd9101-4747-4bcb-9e52-f09f723c5b74 req-1666607c-fa9d-4546-9835-c5b4dd89cada service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033612 Aug 18 12:33:20.057543 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 528/1047] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:20.881013 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:20.881560 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:20.888219 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:20.888702 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:20.889128 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:20.889813 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:20.890385 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:20.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:20.927255 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:20.927783 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:20.928216 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:20.928679 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lazy-loading 'fault' on Instance uuid 3117e783-eb44-4f04-bc13-e23f98d63bc0 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:33:20.975574 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ed3f0ca7c44672a42aa774b02de88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b496e7df3e4e5d8781c49101c619c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:20.986667 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-333f2c85-36b1-4ac3-a75d-7e7699c0db70 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 200 len: 1332 microversion: 2.1 time: 0.108096 Aug 18 12:33:20.986667 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 520/1048] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:20 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:22.007525 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:22.008263 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:22.014905 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:22.015395 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:22.015861 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:22.016549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:22.017000 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:22.017419 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:22.030461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 HTTP/1.1 Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:33:22.032119 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:22.033822 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '3117e783-eb44-4f04-bc13-e23f98d63bc0'} Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:22.034939 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:22.036573 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:22.038108 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:22.038108 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3001928a-49a1-44a2-9e4f-e6c6e51d6597 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 404 len: 111 microversion: 2.1 time: 0.030224 Aug 18 12:33:22.038108 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 529/1049] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:22 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:33:22.042947 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-7b172d13-9485-4f56-bb38-4968f65aa485 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '.version_select at 0x7f3794cc7550>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:22.102142 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-7b172d13-9485-4f56-bb38-4968f65aa485 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865028734" status: 202 len: 0 microversion: 2.1 time: 0.062889 Aug 18 12:33:22.102735 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 521/1050] 10.222.0.98 () {58 vars in 1221 bytes} [Thu Aug 18 12:33:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865028734 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:33:24.098292 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:24.098794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:24.105756 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:24.106241 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:24.106674 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:24.107364 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:24.107847 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:24.108270 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:24.122176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: DELETE /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 HTTP/1.1 Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:33:24.123750 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:24.125301 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '3117e783-eb44-4f04-bc13-e23f98d63bc0'} Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:24.126353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:24.128071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:24.129675 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:24.129675 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-fc8a0785-e874-4287-87b3-5567e2d46d60 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 404 len: 111 microversion: 2.1 time: 0.030655 Aug 18 12:33:24.129675 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 530/1051] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:33:24 2022] DELETE /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:33:24.133635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:24.134248 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3117e783-eb44-4f04-bc13-e23f98d63bc0] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:24.141314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:24.141796 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:24.142230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:24.142916 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:24.143368 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:24.143822 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:24.156721 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 HTTP/1.1 Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:33:24.158355 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:24.160005 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '3117e783-eb44-4f04-bc13-e23f98d63bc0'} Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:24.161029 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. Aug 18 12:33:24.162562 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:24.164661 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 3117e783-eb44-4f04-bc13-e23f98d63bc0 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:24.164661 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-6e4e89bc-855f-4831-8e7c-919272dbe4a7 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0" status: 404 len: 111 microversion: 2.1 time: 0.030067 Aug 18 12:33:24.164661 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 522/1052] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:24 2022] GET /compute/v2.1/servers/3117e783-eb44-4f04-bc13-e23f98d63bc0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:33:25.433889 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:25.434371 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:25.440836 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:25.441503 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:25.441942 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:25.442629 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:25.443078 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:25.443528 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:25.457206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: DELETE /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b HTTP/1.1 Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:33:25.458733 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:33:25.460452 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '96c5df6e-7b55-47e0-b043-61faf4dac47b'} Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:25.461995 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:33:25.463794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.465321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:25.465321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-e45a0c67-c128-4867-8af0-340e805d6763 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 404 len: 111 microversion: 2.1 time: 0.030134 Aug 18 12:33:25.465321 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 531/1053] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:33:25 2022] DELETE /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:33:25.470532 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:25.471141 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 96c5df6e-7b55-47e0-b043-61faf4dac47b] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:25.477291 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:25.477761 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:25.478187 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:25.478863 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:25.479308 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:25.479756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:25.492730 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b HTTP/1.1 Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:33:25.494224 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:33:25.495980 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '96c5df6e-7b55-47e0-b043-61faf4dac47b'} Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:25.497620 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. Aug 18 12:33:25.499099 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.500474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 96c5df6e-7b55-47e0-b043-61faf4dac47b could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:25.500474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3cd72c3d-9e9a-4df8-a2f3-073592756eb8 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b" status: 404 len: 111 microversion: 2.1 time: 0.028886 Aug 18 12:33:25.500474 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 523/1054] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:25 2022] GET /compute/v2.1/servers/96c5df6e-7b55-47e0-b043-61faf4dac47b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:33:25.503871 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:25.504367 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:25.510841 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:25.511441 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:25.511779 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:25.512462 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:25.512912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:25.513332 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:25.526991 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: DELETE /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 HTTP/1.1 Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:33:25.528548 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:33:25.530158 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '9dffa315-14de-447c-9091-a2ebc33584f8'} Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:25.531212 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:33:25.532731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.534372 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:25.534372 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-33644682-6435-48ff-92a5-6cd7d3932171 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 404 len: 111 microversion: 2.1 time: 0.029833 Aug 18 12:33:25.534372 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 532/1055] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:33:25 2022] DELETE /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:33:25.538145 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:25.538755 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 9dffa315-14de-447c-9091-a2ebc33584f8] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:25.544635 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:25.545114 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:25.545549 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:25.546267 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:25.546725 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:25.547151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:25.560187 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 HTTP/1.1 Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:33:25.561695 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:33:25.563314 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '9dffa315-14de-447c-9091-a2ebc33584f8'} Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:25.564271 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. Aug 18 12:33:25.565505 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:25.566628 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 9dffa315-14de-447c-9091-a2ebc33584f8 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:25.566628 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-17aa5550-baa0-4fd1-bb26-001435cba750 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8" status: 404 len: 111 microversion: 2.1 time: 0.028611 Aug 18 12:33:25.566628 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 524/1056] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:25 2022] GET /compute/v2.1/servers/9dffa315-14de-447c-9091-a2ebc33584f8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:33:26.863743 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:26.864356 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:26.870718 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:26.871196 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:26.871660 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:26.872349 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:26.872799 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:26.873218 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:26.886656 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: DELETE /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 HTTP/1.1 Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:33:26.888314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:33:26.890001 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '3757ba7d-3058-4402-809d-f211ff48ab91'} Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:26.890957 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:33:26.892535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:26.894032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:26.894032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3eb61878-34b0-4feb-ad17-0f44a8fafe25 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 404 len: 111 microversion: 2.1 time: 0.029897 Aug 18 12:33:26.894032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 533/1057] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:33:26 2022] DELETE /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:33:26.898043 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:26.899198 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] [instance: 3757ba7d-3058-4402-809d-f211ff48ab91] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:26.905643 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:26.906146 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:26.906575 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:26.907254 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:26.907731 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:26.908151 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:26.923580 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] HTTP exception thrown: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Request method failure captured: Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 HTTP/1.1 Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jCO6b-r3gugLN0sshlUooiVGov2qKSUASlHUjEIATfVhBdEy1Kfu8vwQUVRSH3S7MUGTLQKBg96lRGDu9r48TP1-uQH_o2-tkF2A0prsXAlLx0-BWQTlo5_FA60De32J35j_p0pYxi3m3lrM2bSCm1YptFdIZYpDMaZ6UvXzB6X5EE Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:33:26.925024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86b496e7df3e4e5d8781c49101c619c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: 86b496e7df3e4e5d8781c49101c619c2 Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296194664 Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 27ed3f0ca7c44672a42aa774b02de88c Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-AttachVolumeNegativeTest-1296194664-project Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:33:26.926648 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '3757ba7d-3058-4402-809d-f211ff48ab91'} Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:26.927634 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. Aug 18 12:33:26.929165 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:33:26.930544 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] Returning 404 to user: Instance 3757ba7d-3058-4402-809d-f211ff48ab91 could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:26.930544 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-45106739-61b1-43eb-98ee-0a52241b0cc3 tempest-AttachVolumeNegativeTest-1296194664 tempest-AttachVolumeNegativeTest-1296194664-project] 10.222.0.98 "GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91" status: 404 len: 111 microversion: 2.1 time: 0.032152 Aug 18 12:33:26.930544 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 525/1058] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:26 2022] GET /compute/v2.1/servers/3757ba7d-3058-4402-809d-f211ff48ab91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:33:32.151338 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-2aaabf64-676b-4ea1-acef-f82bd80da5d2 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Action: 'create', calling method: .version_select at 0x7f379885e3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1983096585"}} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:32.805529 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-2aaabf64-676b-4ea1-acef-f82bd80da5d2 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.771274 Aug 18 12:33:32.806165 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 534/1059] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Aug 18 12:33:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 773 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 12:33:32.818540 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a23a17b2-1c51-4eb1-b962-7e196369e28a tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f3787dff9d0>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:32.868706 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a23a17b2-1c51-4eb1-b962-7e196369e28a tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c" status: 200 len: 345 microversion: 2.1 time: 0.053715 Aug 18 12:33:32.869127 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 526/1060] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:33:32 2022] GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:33.882739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c63b4be6-ad03-4e60-a729-e8c328354b7d tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f379422c8b0>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:33.932475 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c63b4be6-ad03-4e60-a729-e8c328354b7d tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c" status: 200 len: 346 microversion: 2.1 time: 0.054127 Aug 18 12:33:33.933008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 535/1061] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:33:33 2022] GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:33.945893 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-68a73c70-7310-4eeb-bc2e-561fb3464830 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Action: 'create', calling method: .version_select at 0x7f3794a37e50>, body: {"snapshot": {"volume_id": "119b7293-8cd2-48a9-b401-7a36f95f8e7c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-515716190"}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:34.393918 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-68a73c70-7310-4eeb-bc2e-561fb3464830 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.452265 Aug 18 12:33:34.394503 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 527/1062] 10.222.0.98 () {60 vars in 1162 bytes} [Thu Aug 18 12:33:33 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:34.405493 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-29965ebd-14f9-418e-9a79-11ac6ddc094d tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f379885ee50>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:34.434770 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-29965ebd-14f9-418e-9a79-11ac6ddc094d tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 200 len: 286 microversion: 2.1 time: 0.033001 Aug 18 12:33:34.435377 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 536/1063] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Aug 18 12:33:34 2022] GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:34.446787 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b00ef6df-13ac-4293-b9b8-b5d5dad8fb8f tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f379498aee0>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:34.478401 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b00ef6df-13ac-4293-b9b8-b5d5dad8fb8f tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036067 Aug 18 12:33:34.478990 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 528/1064] 10.222.0.98 () {58 vars in 1140 bytes} [Thu Aug 18 12:33:34 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:34.490049 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ef49838b-27c0-48cb-a656-4453f96f2949 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f3794079c10>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:34.519677 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ef49838b-27c0-48cb-a656-4453f96f2949 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 200 len: 286 microversion: 2.1 time: 0.033439 Aug 18 12:33:34.520229 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 537/1065] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Aug 18 12:33:34 2022] GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:35.533467 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8338521c-6d75-48c3-9f83-7e0626d72229 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f3795e8e040>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:35.564776 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8338521c-6d75-48c3-9f83-7e0626d72229 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 200 len: 286 microversion: 2.1 time: 0.035671 Aug 18 12:33:35.565656 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 529/1066] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Aug 18 12:33:35 2022] GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:36.577989 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-5ccaa86d-9383-4517-90c3-b67232422ac5 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f37941e59d0>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:36.607740 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-5ccaa86d-9383-4517-90c3-b67232422ac5 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 200 len: 286 microversion: 2.1 time: 0.034006 Aug 18 12:33:36.608327 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 538/1067] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Aug 18 12:33:36 2022] GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:37.618504 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:37.619265 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:37.623007 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ce42fd57-ce4a-4486-a737-42e0a993c89e tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f3787efc430>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:37.652248 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ce42fd57-ce4a-4486-a737-42e0a993c89e tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 200 len: 286 microversion: 2.1 time: 0.035695 Aug 18 12:33:37.652814 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 530/1068] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Aug 18 12:33:37 2022] GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:33:38.661318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:38.662185 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:38.666947 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-191be265-7cbe-4c87-a6ed-de65a317a031 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f37941e59d0>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:38.699144 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-191be265-7cbe-4c87-a6ed-de65a317a031 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 200 len: 286 microversion: 2.1 time: 0.038547 Aug 18 12:33:38.699744 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 539/1069] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Aug 18 12:33:38 2022] GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:39.713559 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-72bd7c10-1fc2-4c84-ba5d-a4ab93f9ca1b tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f3787dffd30>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:39.744431 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-72bd7c10-1fc2-4c84-ba5d-a4ab93f9ca1b tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 200 len: 286 microversion: 2.1 time: 0.036534 Aug 18 12:33:39.745116 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 531/1070] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Aug 18 12:33:39 2022] GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:40.757759 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-82f40612-5150-4af6-8241-534ecc542fd8 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f37988feaf0>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:40.788405 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-82f40612-5150-4af6-8241-534ecc542fd8 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 200 len: 287 microversion: 2.1 time: 0.034798 Aug 18 12:33:40.789631 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 540/1071] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Aug 18 12:33:40 2022] GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:40.801194 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-269e6b5a-c18a-4d7f-bf77-89d1c234459e tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f3787ef74c0>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:40.987171 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-269e6b5a-c18a-4d7f-bf77-89d1c234459e tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "DELETE /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 202 len: 0 microversion: 2.1 time: 0.190362 Aug 18 12:33:40.987779 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 532/1072] 10.222.0.98 () {58 vars in 1254 bytes} [Thu Aug 18 12:33:40 2022] DELETE /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:33:40.996137 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-55c5141d-bd91-4fff-a904-28938ca748d4 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f3787fc6820>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:41.029101 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-55c5141d-bd91-4fff-a904-28938ca748d4 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 200 len: 286 microversion: 2.1 time: 0.036819 Aug 18 12:33:41.029679 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 541/1073] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Aug 18 12:33:40 2022] GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:42.042519 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-b0ba2f9e-ba17-44cf-aae1-feec37a9eb59 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f3795ee3d30>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:42.073086 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-b0ba2f9e-ba17-44cf-aae1-feec37a9eb59 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 200 len: 286 microversion: 2.1 time: 0.035275 Aug 18 12:33:42.073652 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 533/1074] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Aug 18 12:33:42 2022] GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:43.086087 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a4320348-72e2-4ddd-8a4b-13d1541e684e tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f37944f2820>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:43.111973 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-a4320348-72e2-4ddd-8a4b-13d1541e684e tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] HTTP exception thrown: Snapshot b9327f90-ef22-490f-9f92-7f848f7c76a1 could not be found. Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a4320348-72e2-4ddd-8a4b-13d1541e684e tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Request method failure captured: Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 HTTP/1.1 Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jGbCc6uwbiB463NrX47oW7KcKvhAR-ynva__-tVNcUlqz3V12UB4fIytN6NaTKx-LClbxpW5Q_Ha5MtbfdcD3vz3C0IZQTOOKfAhAY3TTl96ZwM93FeFhDlbE0qIHkw8GKTxxWcqg4k3pwKHW5tD9DmTy5lHy807Vn0PL_FyfeT4zU Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 04767bc06d674ddea586d44324065975 Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:33:43.114206 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/04767bc06d674ddea586d44324065975"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/04767bc06d674ddea586d44324065975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/04767bc06d674ddea586d44324065975"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_04767bc06d674ddea586d44324065975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 04767bc06d674ddea586d44324065975 Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-VolumesSnapshotsTestJSON-1211777913-project Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 78621860936e4b1bbaf8219cc47a06b9 Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1211777913-project Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Snapshot b9327f90-ef22-490f-9f92-7f848f7c76a1 could not be found. Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': 'b9327f90-ef22-490f-9f92-7f848f7c76a1'} Aug 18 12:33:43.115964 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b9327f90-ef22-490f-9f92-7f848f7c76a1 could not be found. (HTTP 404) (Request-ID: req-7c529702-ff40-4c88-96e8-b40198d0e549) Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:43.117243 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:33:43.119331 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b9327f90-ef22-490f-9f92-7f848f7c76a1 could not be found. Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 18 12:33:43.121057 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b9327f90-ef22-490f-9f92-7f848f7c76a1 could not be found. Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b9327f90-ef22-490f-9f92-7f848f7c76a1 could not be found. Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a4320348-72e2-4ddd-8a4b-13d1541e684e tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Returning 404 to user: Snapshot b9327f90-ef22-490f-9f92-7f848f7c76a1 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:43.122940 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a4320348-72e2-4ddd-8a4b-13d1541e684e tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1" status: 404 len: 111 microversion: 2.1 time: 0.034064 Aug 18 12:33:43.124037 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 542/1075] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Aug 18 12:33:43 2022] GET /compute/v2.1/os-snapshots/b9327f90-ef22-490f-9f92-7f848f7c76a1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:33:43.127433 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-1da0e427-0eef-4301-ac5e-433c89120186 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f379498a3a0>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:43.344764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-1da0e427-0eef-4301-ac5e-433c89120186 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c" status: 202 len: 0 microversion: 2.1 time: 0.223447 Aug 18 12:33:43.347799 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 534/1076] 10.222.0.98 () {58 vars in 1248 bytes} [Thu Aug 18 12:33:43 2022] DELETE /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:33:43.353807 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-c5db2ea6-800e-4a1b-89a2-ff8a1056f117 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f37940ab280>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:43.401778 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-c5db2ea6-800e-4a1b-89a2-ff8a1056f117 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c" status: 200 len: 345 microversion: 2.1 time: 0.051868 Aug 18 12:33:43.402337 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 543/1077] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:33:43 2022] GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:44.048097 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1078661792", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-229203386", "security_groups": [{"name": "tempest-secgroup-smoke-2046157390"}], "block_device_mapping_v2": [{"uuid": "c368303c-952d-477b-8b99-04e26b2cc325", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4f234a1b-725a-4b27-82c4-838eed1ed10a"}]}} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:44.164428 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.network.neutron [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] validate_networks() for [('4f234a1b-725a-4b27-82c4-838eed1ed10a', None, None, None, None, None)] {{(pid=121244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:33:44.416854 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cbe2580e-b8b9-4ee0-9e9a-3d18f4022217 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f379891e9d0>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:44.444585 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-cbe2580e-b8b9-4ee0-9e9a-3d18f4022217 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] HTTP exception thrown: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cbe2580e-b8b9-4ee0-9e9a-3d18f4022217 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Request method failure captured: Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c HTTP/1.1 Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jGbCc6uwbiB463NrX47oW7KcKvhAR-ynva__-tVNcUlqz3V12UB4fIytN6NaTKx-LClbxpW5Q_Ha5MtbfdcD3vz3C0IZQTOOKfAhAY3TTl96ZwM93FeFhDlbE0qIHkw8GKTxxWcqg4k3pwKHW5tD9DmTy5lHy807Vn0PL_FyfeT4zU Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 04767bc06d674ddea586d44324065975 Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:33:44.447211 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/04767bc06d674ddea586d44324065975"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/04767bc06d674ddea586d44324065975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/04767bc06d674ddea586d44324065975"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_04767bc06d674ddea586d44324065975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 04767bc06d674ddea586d44324065975 Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-VolumesSnapshotsTestJSON-1211777913-project Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 78621860936e4b1bbaf8219cc47a06b9 Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1211777913-project Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '119b7293-8cd2-48a9-b401-7a36f95f8e7c'} Aug 18 12:33:44.448864 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. (HTTP 404) (Request-ID: req-15965840-5278-4a05-a41c-8b273ff835dd) Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:44.449945 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:33:44.451521 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 12:33:44.452722 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-cbe2580e-b8b9-4ee0-9e9a-3d18f4022217 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Returning 404 to user: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-cbe2580e-b8b9-4ee0-9e9a-3d18f4022217 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c" status: 404 len: 109 microversion: 2.1 time: 0.036381 Aug 18 12:33:44.454011 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 544/1078] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:33:44 2022] GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:33:44.464103 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-73f555c2-bc66-4390-a097-373c216ff2e9 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f37942a0700>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:44.491751 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-73f555c2-bc66-4390-a097-373c216ff2e9 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] HTTP exception thrown: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-73f555c2-bc66-4390-a097-373c216ff2e9 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Request method failure captured: Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: DELETE /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c HTTP/1.1 Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jGbCc6uwbiB463NrX47oW7KcKvhAR-ynva__-tVNcUlqz3V12UB4fIytN6NaTKx-LClbxpW5Q_Ha5MtbfdcD3vz3C0IZQTOOKfAhAY3TTl96ZwM93FeFhDlbE0qIHkw8GKTxxWcqg4k3pwKHW5tD9DmTy5lHy807Vn0PL_FyfeT4zU Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 04767bc06d674ddea586d44324065975 Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:33:44.493827 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/04767bc06d674ddea586d44324065975"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/04767bc06d674ddea586d44324065975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/04767bc06d674ddea586d44324065975"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_04767bc06d674ddea586d44324065975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 04767bc06d674ddea586d44324065975 Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-VolumesSnapshotsTestJSON-1211777913-project Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 78621860936e4b1bbaf8219cc47a06b9 Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1211777913-project Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '119b7293-8cd2-48a9-b401-7a36f95f8e7c'} Aug 18 12:33:44.495438 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. (HTTP 404) (Request-ID: req-00d8f438-22f6-4eb0-beb3-c92e1ff3207c) Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:44.496416 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 12:33:44.497700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 12:33:44.498901 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-73f555c2-bc66-4390-a097-373c216ff2e9 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Returning 404 to user: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:44.500785 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-73f555c2-bc66-4390-a097-373c216ff2e9 tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c" status: 404 len: 109 microversion: 2.1 time: 0.036011 Aug 18 12:33:44.501829 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 545/1079] 10.222.0.98 () {58 vars in 1248 bytes} [Thu Aug 18 12:33:44 2022] DELETE /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:33:44.507660 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a9db31f3-f187-4903-8467-a98cf44ff5ba tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Calling method '.version_select at 0x7f37941e59d0>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:44.538257 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-a9db31f3-f187-4903-8467-a98cf44ff5ba tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] HTTP exception thrown: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a9db31f3-f187-4903-8467-a98cf44ff5ba tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Request method failure captured: Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c HTTP/1.1 Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jGbCc6uwbiB463NrX47oW7KcKvhAR-ynva__-tVNcUlqz3V12UB4fIytN6NaTKx-LClbxpW5Q_Ha5MtbfdcD3vz3C0IZQTOOKfAhAY3TTl96ZwM93FeFhDlbE0qIHkw8GKTxxWcqg4k3pwKHW5tD9DmTy5lHy807Vn0PL_FyfeT4zU Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: 04767bc06d674ddea586d44324065975 Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:33:44.540240 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/04767bc06d674ddea586d44324065975"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/04767bc06d674ddea586d44324065975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/04767bc06d674ddea586d44324065975"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_04767bc06d674ddea586d44324065975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: 04767bc06d674ddea586d44324065975 Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1211777913 Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-VolumesSnapshotsTestJSON-1211777913-project Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 78621860936e4b1bbaf8219cc47a06b9 Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1211777913-project Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '119b7293-8cd2-48a9-b401-7a36f95f8e7c'} Aug 18 12:33:44.541955 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. (HTTP 404) (Request-ID: req-e496cd2a-5190-4321-8a5d-e60f564f9e9d) Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:44.542882 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:33:44.544329 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 12:33:44.545912 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-a9db31f3-f187-4903-8467-a98cf44ff5ba tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] Returning 404 to user: Volume 119b7293-8cd2-48a9-b401-7a36f95f8e7c could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-a9db31f3-f187-4903-8467-a98cf44ff5ba tempest-VolumesSnapshotsTestJSON-1211777913 tempest-VolumesSnapshotsTestJSON-1211777913-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c" status: 404 len: 109 microversion: 2.1 time: 0.040010 Aug 18 12:33:44.547488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 546/1080] 10.222.0.98 () {58 vars in 1245 bytes} [Thu Aug 18 12:33:44 2022] GET /compute/v2.1/os-volumes/119b7293-8cd2-48a9-b401-7a36f95f8e7c => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:33:44.645633 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Flavor limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:33:44.646058 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Image limits 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:33:44.646537 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Flavor pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:33:44.646948 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Image pref 0:0:0 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:33:44.647363 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.virt.hardware [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:33:44.657668 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:44.658153 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:44.658589 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:44.659312 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:44.659797 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:44.660220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:44.677102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Getting quotas for project c1534d6a880c4f44b741ff5b208663bc. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:33:44.681665 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.quota [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Getting quotas for user 3907830851364a73b4d3715280a132bc and project c1534d6a880c4f44b741ff5b208663bc. Resources: {'ram', 'instances', 'cores'} {{(pid=121244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:33:44.741019 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Going to run 1 instances... {{(pid=121244) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:33:44.741295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c368303c-952d-477b-8b99-04e26b2cc325',volume_size=None,volume_type=None)] {{(pid=121244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:33:45.266983 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [8043f4d8-de2e-4704-a2ef-3299d5464828] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 12:33:46.274051 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO oslo.messaging._drivers.impl_rabbit [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [8043f4d8-de2e-4704-a2ef-3299d5464828] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 35070. Aug 18 12:33:46.277801 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-5a07fdfe-b6c9-4a0d-893d-8fa32e8ac71e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.233697 Aug 18 12:33:46.278457 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 535/1081] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Aug 18 12:33:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 2235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:33:46.289916 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ace15ef2-79a5-4ae7-b447-730bd0fadfae tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:46.290643 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ace15ef2-79a5-4ae7-b447-730bd0fadfae tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:46.349571 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ace15ef2-79a5-4ae7-b447-730bd0fadfae tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:46.357883 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ace15ef2-79a5-4ae7-b447-730bd0fadfae tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1094 microversion: 2.1 time: 0.072275 Aug 18 12:33:46.358522 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 547/1082] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:46 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:47.381251 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-8ca724b9-2263-4474-9ca8-e89258c6b752 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:47.382609 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-8ca724b9-2263-4474-9ca8-e89258c6b752 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:47.443300 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-8ca724b9-2263-4474-9ca8-e89258c6b752 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:47.450309 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-8ca724b9-2263-4474-9ca8-e89258c6b752 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1094 microversion: 2.1 time: 0.074610 Aug 18 12:33:47.450881 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 536/1083] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:47 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:48.471318 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3a9e57a1-2916-48e3-bce2-28fc1152314d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:48.472244 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3a9e57a1-2916-48e3-bce2-28fc1152314d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:48.529877 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3a9e57a1-2916-48e3-bce2-28fc1152314d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:48.537279 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3a9e57a1-2916-48e3-bce2-28fc1152314d tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1094 microversion: 2.1 time: 0.070598 Aug 18 12:33:48.537894 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 548/1084] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:48 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:49.857939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-991a75a3-0f32-4231-8d97-fdbe7920d9d4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:49.858546 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-991a75a3-0f32-4231-8d97-fdbe7920d9d4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:49.918728 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-991a75a3-0f32-4231-8d97-fdbe7920d9d4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:49.925677 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-991a75a3-0f32-4231-8d97-fdbe7920d9d4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1094 microversion: 2.1 time: 0.371527 Aug 18 12:33:49.926253 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 537/1085] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:49 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1094 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:50.946094 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-3e001a00-17f3-4d9f-89ef-186fb1aa4e9b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:50.946631 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-3e001a00-17f3-4d9f-89ef-186fb1aa4e9b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:50.954275 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e001a00-17f3-4d9f-89ef-186fb1aa4e9b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:50.957408 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e001a00-17f3-4d9f-89ef-186fb1aa4e9b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:50.957408 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e001a00-17f3-4d9f-89ef-186fb1aa4e9b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:50.957408 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e001a00-17f3-4d9f-89ef-186fb1aa4e9b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:50.957408 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e001a00-17f3-4d9f-89ef-186fb1aa4e9b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:50.957932 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-3e001a00-17f3-4d9f-89ef-186fb1aa4e9b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:51.016664 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-3e001a00-17f3-4d9f-89ef-186fb1aa4e9b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:51.024061 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-3e001a00-17f3-4d9f-89ef-186fb1aa4e9b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1144 microversion: 2.1 time: 0.081883 Aug 18 12:33:51.024625 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 549/1086] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:50 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:52.045207 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a6a7d772-8e9e-4658-a32f-2d3bb9104617 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:52.045756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a6a7d772-8e9e-4658-a32f-2d3bb9104617 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:52.052285 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a6a7d772-8e9e-4658-a32f-2d3bb9104617 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:52.052755 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a6a7d772-8e9e-4658-a32f-2d3bb9104617 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:52.053192 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a6a7d772-8e9e-4658-a32f-2d3bb9104617 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:52.053889 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a6a7d772-8e9e-4658-a32f-2d3bb9104617 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:52.054345 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a6a7d772-8e9e-4658-a32f-2d3bb9104617 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:52.054780 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a6a7d772-8e9e-4658-a32f-2d3bb9104617 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:52.123046 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a6a7d772-8e9e-4658-a32f-2d3bb9104617 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:52.135303 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a6a7d772-8e9e-4658-a32f-2d3bb9104617 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1192 microversion: 2.1 time: 0.094523 Aug 18 12:33:52.135923 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 538/1087] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:52 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:53.157410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-4ba9b9b4-8325-4e9f-8911-b6443dfcfd5e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:53.158616 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-4ba9b9b4-8325-4e9f-8911-b6443dfcfd5e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:53.174420 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ba9b9b4-8325-4e9f-8911-b6443dfcfd5e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:53.176381 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ba9b9b4-8325-4e9f-8911-b6443dfcfd5e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:53.176835 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ba9b9b4-8325-4e9f-8911-b6443dfcfd5e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:53.178087 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ba9b9b4-8325-4e9f-8911-b6443dfcfd5e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:53.184581 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ba9b9b4-8325-4e9f-8911-b6443dfcfd5e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:53.184581 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-4ba9b9b4-8325-4e9f-8911-b6443dfcfd5e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:53.393032 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-4ba9b9b4-8325-4e9f-8911-b6443dfcfd5e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:53.401788 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-4ba9b9b4-8325-4e9f-8911-b6443dfcfd5e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1278 microversion: 2.1 time: 0.248559 Aug 18 12:33:53.402888 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 550/1088] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:53 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:53.998601 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-5e33c194-110e-46d7-b018-913d541bfeb6 req-dca6f0de-37b9-49c5-a8c3-744c695dfbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bfdb209-645a-4354-b095-977eb38406f5", "tag": "a1e10ded-ea1a-4c85-af89-4232f64a308a"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:54.008291 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-5e33c194-110e-46d7-b018-913d541bfeb6 req-dca6f0de-37b9-49c5-a8c3-744c695dfbe1 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:54.008766 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-5e33c194-110e-46d7-b018-913d541bfeb6 req-dca6f0de-37b9-49c5-a8c3-744c695dfbe1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:54.009191 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-5e33c194-110e-46d7-b018-913d541bfeb6 req-dca6f0de-37b9-49c5-a8c3-744c695dfbe1 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:54.021209 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-5e33c194-110e-46d7-b018-913d541bfeb6 req-dca6f0de-37b9-49c5-a8c3-744c695dfbe1 service nova] Creating event network-changed:a1e10ded-ea1a-4c85-af89-4232f64a308a for instance 9bfdb209-645a-4354-b095-977eb38406f5 on hv-cinder-83602 Aug 18 12:33:54.027206 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-5e33c194-110e-46d7-b018-913d541bfeb6 req-dca6f0de-37b9-49c5-a8c3-744c695dfbe1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033115 Aug 18 12:33:54.027860 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 539/1089] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:54.425078 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-73061857-f0de-43dd-8b90-d8d709af962b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:54.426345 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-73061857-f0de-43dd-8b90-d8d709af962b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:54.438686 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-73061857-f0de-43dd-8b90-d8d709af962b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:54.439186 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-73061857-f0de-43dd-8b90-d8d709af962b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:54.441309 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-73061857-f0de-43dd-8b90-d8d709af962b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:54.441309 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-73061857-f0de-43dd-8b90-d8d709af962b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:54.441309 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-73061857-f0de-43dd-8b90-d8d709af962b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:54.441309 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-73061857-f0de-43dd-8b90-d8d709af962b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:54.597091 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-73061857-f0de-43dd-8b90-d8d709af962b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:54.607100 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-73061857-f0de-43dd-8b90-d8d709af962b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.185886 Aug 18 12:33:54.607811 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 551/1090] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:54 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:55.627333 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=2 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:55.632236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-f883f698-0132-449e-83fd-1d371f1d6287 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:55.638214 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-f883f698-0132-449e-83fd-1d371f1d6287 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:55.639817 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f883f698-0132-449e-83fd-1d371f1d6287 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:55.640383 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f883f698-0132-449e-83fd-1d371f1d6287 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:55.640827 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f883f698-0132-449e-83fd-1d371f1d6287 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:55.641602 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f883f698-0132-449e-83fd-1d371f1d6287 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:55.642063 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f883f698-0132-449e-83fd-1d371f1d6287 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:55.642497 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-f883f698-0132-449e-83fd-1d371f1d6287 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:55.779939 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-f883f698-0132-449e-83fd-1d371f1d6287 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:55.788003 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-f883f698-0132-449e-83fd-1d371f1d6287 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.161545 Aug 18 12:33:55.788595 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 540/1091] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:55 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:56.809376 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-20b335aa-df6e-4bfe-a84c-f1cc64315d60 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:56.809989 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-20b335aa-df6e-4bfe-a84c-f1cc64315d60 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:56.816607 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20b335aa-df6e-4bfe-a84c-f1cc64315d60 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:56.817090 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20b335aa-df6e-4bfe-a84c-f1cc64315d60 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:56.817528 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20b335aa-df6e-4bfe-a84c-f1cc64315d60 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:56.818219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20b335aa-df6e-4bfe-a84c-f1cc64315d60 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:56.818854 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20b335aa-df6e-4bfe-a84c-f1cc64315d60 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:56.819169 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-20b335aa-df6e-4bfe-a84c-f1cc64315d60 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:56.954276 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-20b335aa-df6e-4bfe-a84c-f1cc64315d60 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:56.961611 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-20b335aa-df6e-4bfe-a84c-f1cc64315d60 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.156178 Aug 18 12:33:56.962170 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 552/1092] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:56 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:57.982750 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-424149a3-4eca-43d5-acdf-7971555ee7aa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:57.983397 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-424149a3-4eca-43d5-acdf-7971555ee7aa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:57.990113 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-424149a3-4eca-43d5-acdf-7971555ee7aa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:57.990600 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-424149a3-4eca-43d5-acdf-7971555ee7aa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:57.991040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-424149a3-4eca-43d5-acdf-7971555ee7aa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:57.991771 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-424149a3-4eca-43d5-acdf-7971555ee7aa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:57.992226 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-424149a3-4eca-43d5-acdf-7971555ee7aa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:57.992654 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-424149a3-4eca-43d5-acdf-7971555ee7aa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:58.128524 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-424149a3-4eca-43d5-acdf-7971555ee7aa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:58.136859 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-424149a3-4eca-43d5-acdf-7971555ee7aa tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.158020 Aug 18 12:33:58.137421 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 541/1093] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:57 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:59.157071 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-30b5aa87-938f-4810-ae8d-698147a4458f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:59.157825 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-30b5aa87-938f-4810-ae8d-698147a4458f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:59.160314 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell0:SELECT=4 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:59.165182 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30b5aa87-938f-4810-ae8d-698147a4458f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:59.166155 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30b5aa87-938f-4810-ae8d-698147a4458f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:59.166592 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30b5aa87-938f-4810-ae8d-698147a4458f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:59.169010 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30b5aa87-938f-4810-ae8d-698147a4458f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:59.169010 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30b5aa87-938f-4810-ae8d-698147a4458f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:59.169010 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-30b5aa87-938f-4810-ae8d-698147a4458f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:59.301717 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-30b5aa87-938f-4810-ae8d-698147a4458f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:59.309853 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-30b5aa87-938f-4810-ae8d-698147a4458f tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.156871 Aug 18 12:33:59.310445 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 553/1094] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:59 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:00.330089 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-3c8caed0-a8a2-45d8-9f53-937d2bf07050 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:00.330732 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-3c8caed0-a8a2-45d8-9f53-937d2bf07050 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:00.333054 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell0:SELECT=10 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:00.338388 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c8caed0-a8a2-45d8-9f53-937d2bf07050 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:00.338905 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c8caed0-a8a2-45d8-9f53-937d2bf07050 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:00.339346 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c8caed0-a8a2-45d8-9f53-937d2bf07050 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:00.340076 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c8caed0-a8a2-45d8-9f53-937d2bf07050 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:00.340534 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c8caed0-a8a2-45d8-9f53-937d2bf07050 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:00.340962 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-3c8caed0-a8a2-45d8-9f53-937d2bf07050 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:00.480024 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-3c8caed0-a8a2-45d8-9f53-937d2bf07050 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:00.488517 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-3c8caed0-a8a2-45d8-9f53-937d2bf07050 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.161315 Aug 18 12:34:00.489219 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 542/1095] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:00 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:01.508826 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-15f6ad41-bf85-4092-b20c-d7065c74e7f6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:01.509461 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-15f6ad41-bf85-4092-b20c-d7065c74e7f6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:01.516250 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15f6ad41-bf85-4092-b20c-d7065c74e7f6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:01.516754 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15f6ad41-bf85-4092-b20c-d7065c74e7f6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:01.517190 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15f6ad41-bf85-4092-b20c-d7065c74e7f6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:01.517896 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15f6ad41-bf85-4092-b20c-d7065c74e7f6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:01.518354 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15f6ad41-bf85-4092-b20c-d7065c74e7f6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:01.518779 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-15f6ad41-bf85-4092-b20c-d7065c74e7f6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:01.651540 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-15f6ad41-bf85-4092-b20c-d7065c74e7f6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:01.659020 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-15f6ad41-bf85-4092-b20c-d7065c74e7f6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.153977 Aug 18 12:34:01.659607 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 554/1096] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:01 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:02.680158 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c84d32ec-e5d5-4d11-a178-94efca9dce8e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:02.680785 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c84d32ec-e5d5-4d11-a178-94efca9dce8e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:02.687757 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c84d32ec-e5d5-4d11-a178-94efca9dce8e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:02.688240 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c84d32ec-e5d5-4d11-a178-94efca9dce8e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:02.688673 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c84d32ec-e5d5-4d11-a178-94efca9dce8e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:02.689366 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c84d32ec-e5d5-4d11-a178-94efca9dce8e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:02.689823 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c84d32ec-e5d5-4d11-a178-94efca9dce8e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:02.690249 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c84d32ec-e5d5-4d11-a178-94efca9dce8e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:02.824485 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c84d32ec-e5d5-4d11-a178-94efca9dce8e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:02.833199 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c84d32ec-e5d5-4d11-a178-94efca9dce8e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.156786 Aug 18 12:34:02.833854 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 543/1097] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:02 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:03.854462 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-affc9bc3-0a86-4df1-9879-b3a5e4852c3b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:03.855124 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-affc9bc3-0a86-4df1-9879-b3a5e4852c3b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:03.862068 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-affc9bc3-0a86-4df1-9879-b3a5e4852c3b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.864767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-affc9bc3-0a86-4df1-9879-b3a5e4852c3b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.864767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-affc9bc3-0a86-4df1-9879-b3a5e4852c3b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.864767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-affc9bc3-0a86-4df1-9879-b3a5e4852c3b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.864767 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-affc9bc3-0a86-4df1-9879-b3a5e4852c3b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.865196 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-affc9bc3-0a86-4df1-9879-b3a5e4852c3b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:04.001826 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-affc9bc3-0a86-4df1-9879-b3a5e4852c3b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:04.009731 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-affc9bc3-0a86-4df1-9879-b3a5e4852c3b tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.159533 Aug 18 12:34:04.010309 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 555/1098] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:03 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:05.032913 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-cfafc65c-3006-4705-8117-99dfba39eb83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:05.033595 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-cfafc65c-3006-4705-8117-99dfba39eb83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:05.039955 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cfafc65c-3006-4705-8117-99dfba39eb83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:05.040427 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cfafc65c-3006-4705-8117-99dfba39eb83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:05.040854 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cfafc65c-3006-4705-8117-99dfba39eb83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:05.041537 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cfafc65c-3006-4705-8117-99dfba39eb83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:05.042657 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cfafc65c-3006-4705-8117-99dfba39eb83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:05.043077 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-cfafc65c-3006-4705-8117-99dfba39eb83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:05.179120 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-cfafc65c-3006-4705-8117-99dfba39eb83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:05.186703 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-cfafc65c-3006-4705-8117-99dfba39eb83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.157631 Aug 18 12:34:05.187283 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 544/1099] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:05 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:05.952917 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-eadc5ebf-8a75-47fe-86d2-918daf20f8f5 req-13109025-ef30-4733-bf3c-4a3e2dba4256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bfdb209-645a-4354-b095-977eb38406f5", "name": "network-vif-plugged", "status": "completed", "tag": "a1e10ded-ea1a-4c85-af89-4232f64a308a"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:05.964699 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-eadc5ebf-8a75-47fe-86d2-918daf20f8f5 req-13109025-ef30-4733-bf3c-4a3e2dba4256 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:05.965171 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-eadc5ebf-8a75-47fe-86d2-918daf20f8f5 req-13109025-ef30-4733-bf3c-4a3e2dba4256 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:05.965654 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-eadc5ebf-8a75-47fe-86d2-918daf20f8f5 req-13109025-ef30-4733-bf3c-4a3e2dba4256 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:05.977345 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-eadc5ebf-8a75-47fe-86d2-918daf20f8f5 req-13109025-ef30-4733-bf3c-4a3e2dba4256 service nova] Creating event network-vif-plugged:a1e10ded-ea1a-4c85-af89-4232f64a308a for instance 9bfdb209-645a-4354-b095-977eb38406f5 on hv-cinder-83602 Aug 18 12:34:05.982435 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-eadc5ebf-8a75-47fe-86d2-918daf20f8f5 req-13109025-ef30-4733-bf3c-4a3e2dba4256 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033097 Aug 18 12:34:05.983006 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 556/1100] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:34:06.207541 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-00bf14fb-58dc-4d6a-8212-a0058d6dc6ed tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:06.208390 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-00bf14fb-58dc-4d6a-8212-a0058d6dc6ed tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:06.217046 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-00bf14fb-58dc-4d6a-8212-a0058d6dc6ed tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:06.217713 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-00bf14fb-58dc-4d6a-8212-a0058d6dc6ed tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:06.218256 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-00bf14fb-58dc-4d6a-8212-a0058d6dc6ed tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:06.219960 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-00bf14fb-58dc-4d6a-8212-a0058d6dc6ed tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:06.220563 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-00bf14fb-58dc-4d6a-8212-a0058d6dc6ed tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:06.221103 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-00bf14fb-58dc-4d6a-8212-a0058d6dc6ed tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:06.371769 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-00bf14fb-58dc-4d6a-8212-a0058d6dc6ed tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:06.379828 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-00bf14fb-58dc-4d6a-8212-a0058d6dc6ed tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.176568 Aug 18 12:34:06.384808 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 545/1101] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:06 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:07.404614 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-ed64c87d-5762-40fe-8356-5e24678f25f3 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:07.405261 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-ed64c87d-5762-40fe-8356-5e24678f25f3 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:07.411558 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed64c87d-5762-40fe-8356-5e24678f25f3 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:07.412052 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed64c87d-5762-40fe-8356-5e24678f25f3 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:07.412488 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed64c87d-5762-40fe-8356-5e24678f25f3 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:07.413194 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed64c87d-5762-40fe-8356-5e24678f25f3 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:07.413648 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed64c87d-5762-40fe-8356-5e24678f25f3 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:07.414076 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-ed64c87d-5762-40fe-8356-5e24678f25f3 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:07.561946 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-ed64c87d-5762-40fe-8356-5e24678f25f3 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:07.569637 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-ed64c87d-5762-40fe-8356-5e24678f25f3 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1266 microversion: 2.1 time: 0.171034 Aug 18 12:34:07.570204 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 557/1102] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:07 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:08.593838 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-61128a76-e144-47f1-a798-4fb0ed4a2946 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:08.594570 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-61128a76-e144-47f1-a798-4fb0ed4a2946 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:08.601150 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61128a76-e144-47f1-a798-4fb0ed4a2946 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:08.601618 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61128a76-e144-47f1-a798-4fb0ed4a2946 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:08.602060 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61128a76-e144-47f1-a798-4fb0ed4a2946 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:08.602754 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61128a76-e144-47f1-a798-4fb0ed4a2946 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:08.603210 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61128a76-e144-47f1-a798-4fb0ed4a2946 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:08.603676 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-61128a76-e144-47f1-a798-4fb0ed4a2946 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:08.744259 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-61128a76-e144-47f1-a798-4fb0ed4a2946 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:08.751862 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-61128a76-e144-47f1-a798-4fb0ed4a2946 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1453 microversion: 2.1 time: 0.162501 Aug 18 12:34:08.752432 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 546/1103] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:08 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:08.773701 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-f2004cc7-4be7-4f76-a7ca-89407c777213 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:08.774332 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-f2004cc7-4be7-4f76-a7ca-89407c777213 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:08.781493 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f2004cc7-4be7-4f76-a7ca-89407c777213 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:08.781971 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f2004cc7-4be7-4f76-a7ca-89407c777213 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:08.782401 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f2004cc7-4be7-4f76-a7ca-89407c777213 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:08.783083 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f2004cc7-4be7-4f76-a7ca-89407c777213 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:08.783561 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f2004cc7-4be7-4f76-a7ca-89407c777213 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:08.783982 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-f2004cc7-4be7-4f76-a7ca-89407c777213 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:08.925131 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-f2004cc7-4be7-4f76-a7ca-89407c777213 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:08.932762 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-f2004cc7-4be7-4f76-a7ca-89407c777213 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1453 microversion: 2.1 time: 0.162954 Aug 18 12:34:08.935655 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 558/1104] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:08 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:11.351507 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-26767680-d2cb-4451-811d-8901592c0265 req-2651175f-babc-410e-9768-ae8611dd8a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bfdb209-645a-4354-b095-977eb38406f5", "tag": "a1e10ded-ea1a-4c85-af89-4232f64a308a"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:11.356521 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:11.362369 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-26767680-d2cb-4451-811d-8901592c0265 req-2651175f-babc-410e-9768-ae8611dd8a44 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:11.362886 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-26767680-d2cb-4451-811d-8901592c0265 req-2651175f-babc-410e-9768-ae8611dd8a44 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:11.363337 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-26767680-d2cb-4451-811d-8901592c0265 req-2651175f-babc-410e-9768-ae8611dd8a44 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:11.368991 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG dbcounter [-] [121244] Writing DB stats nova_cell1:SELECT=53 {{(pid=121244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:11.379170 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-26767680-d2cb-4451-811d-8901592c0265 req-2651175f-babc-410e-9768-ae8611dd8a44 service nova] Creating event network-changed:a1e10ded-ea1a-4c85-af89-4232f64a308a for instance 9bfdb209-645a-4354-b095-977eb38406f5 on hv-cinder-83602 Aug 18 12:34:11.384292 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-26767680-d2cb-4451-811d-8901592c0265 req-2651175f-babc-410e-9768-ae8611dd8a44 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183187 Aug 18 12:34:11.384891 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 547/1105] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:35:32.147713 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:35:32.148429 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Thu Aug 18 12:35:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:35:32.193811 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:35:32.194316 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Thu Aug 18 12:35:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:35:36.718233 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:35:36.718807 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Thu Aug 18 12:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:35:51.456264 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_api:SELECT=28 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:35:51.460031 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef8808be-ca2f-4672-96e8-9597ac5d4520] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 12:35:51.465625 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-b2bda9da-1dbf-4c27-98c9-6d14083cb3f1 req-a1ec2042-a7d9-4280-b9da-cbc36e01d30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bfdb209-645a-4354-b095-977eb38406f5", "tag": "a1e10ded-ea1a-4c85-af89-4232f64a308a"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:35:51.469006 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG dbcounter [-] [121245] Writing DB stats nova_cell1:SELECT=56 {{(pid=121245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:35:51.470288 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7a2f7ecf-21c2-435e-888f-4817bd7f71b4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:51.470794 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7a2f7ecf-21c2-435e-888f-4817bd7f71b4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:51.477295 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-b2bda9da-1dbf-4c27-98c9-6d14083cb3f1 req-a1ec2042-a7d9-4280-b9da-cbc36e01d30d service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:51.477579 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a2f7ecf-21c2-435e-888f-4817bd7f71b4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:51.477929 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-b2bda9da-1dbf-4c27-98c9-6d14083cb3f1 req-a1ec2042-a7d9-4280-b9da-cbc36e01d30d service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:51.478064 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a2f7ecf-21c2-435e-888f-4817bd7f71b4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:51.478437 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-b2bda9da-1dbf-4c27-98c9-6d14083cb3f1 req-a1ec2042-a7d9-4280-b9da-cbc36e01d30d service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:51.478569 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a2f7ecf-21c2-435e-888f-4817bd7f71b4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:51.479156 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a2f7ecf-21c2-435e-888f-4817bd7f71b4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:51.479650 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a2f7ecf-21c2-435e-888f-4817bd7f71b4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:51.480112 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7a2f7ecf-21c2-435e-888f-4817bd7f71b4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:51.490538 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-b2bda9da-1dbf-4c27-98c9-6d14083cb3f1 req-a1ec2042-a7d9-4280-b9da-cbc36e01d30d service nova] Creating event network-changed:a1e10ded-ea1a-4c85-af89-4232f64a308a for instance 9bfdb209-645a-4354-b095-977eb38406f5 on hv-cinder-83602 Aug 18 12:35:51.497312 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-b2bda9da-1dbf-4c27-98c9-6d14083cb3f1 req-a1ec2042-a7d9-4280-b9da-cbc36e01d30d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038824 Aug 18 12:35:51.503476 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 548/1106] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:35:51.506700 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7a2f7ecf-21c2-435e-888f-4817bd7f71b4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Going to try to terminate instance {{(pid=121245) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:35:51.838692 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7a2f7ecf-21c2-435e-888f-4817bd7f71b4 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 204 len: 0 microversion: 2.1 time: 0.384241 Aug 18 12:35:51.839675 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 559/1107] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:35:51 2022] DELETE /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:35:51.848738 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-a7e6f286-bc50-4d96-bbf4-632c2da40c87 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:51.849436 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-a7e6f286-bc50-4d96-bbf4-632c2da40c87 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:51.857044 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a7e6f286-bc50-4d96-bbf4-632c2da40c87 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:51.857535 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a7e6f286-bc50-4d96-bbf4-632c2da40c87 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:51.858135 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a7e6f286-bc50-4d96-bbf4-632c2da40c87 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:51.859040 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a7e6f286-bc50-4d96-bbf4-632c2da40c87 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:51.859711 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a7e6f286-bc50-4d96-bbf4-632c2da40c87 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:51.860142 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-a7e6f286-bc50-4d96-bbf4-632c2da40c87 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:52.172754 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-a7e6f286-bc50-4d96-bbf4-632c2da40c87 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:52.180588 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-a7e6f286-bc50-4d96-bbf4-632c2da40c87 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1577 microversion: 2.1 time: 0.336482 Aug 18 12:35:52.191483 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 549/1108] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:51 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1577 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:35:53.202549 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-7b4c6b95-b07b-4aa2-8870-e14b293e5dcf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:53.203254 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-7b4c6b95-b07b-4aa2-8870-e14b293e5dcf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:53.210171 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7b4c6b95-b07b-4aa2-8870-e14b293e5dcf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:53.210656 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7b4c6b95-b07b-4aa2-8870-e14b293e5dcf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:53.211093 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7b4c6b95-b07b-4aa2-8870-e14b293e5dcf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:53.211834 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7b4c6b95-b07b-4aa2-8870-e14b293e5dcf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:53.212551 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7b4c6b95-b07b-4aa2-8870-e14b293e5dcf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:53.212981 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-7b4c6b95-b07b-4aa2-8870-e14b293e5dcf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:53.404757 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-7b4c6b95-b07b-4aa2-8870-e14b293e5dcf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:53.412459 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-7b4c6b95-b07b-4aa2-8870-e14b293e5dcf tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1459 microversion: 2.1 time: 0.214097 Aug 18 12:35:53.413392 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 560/1109] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:53 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1459 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:35:54.234937 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [req-13efa2f4-f6a8-4eee-9361-0b3085fc87bf req-803a95f7-2ae8-46c9-be24-a08baeda3d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bfdb209-645a-4354-b095-977eb38406f5", "name": "network-vif-deleted", "tag": "a1e10ded-ea1a-4c85-af89-4232f64a308a"}]} {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:35:54.247353 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-13efa2f4-f6a8-4eee-9361-0b3085fc87bf req-803a95f7-2ae8-46c9-be24-a08baeda3d76 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:54.247856 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-13efa2f4-f6a8-4eee-9361-0b3085fc87bf req-803a95f7-2ae8-46c9-be24-a08baeda3d76 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:54.248288 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [req-13efa2f4-f6a8-4eee-9361-0b3085fc87bf req-803a95f7-2ae8-46c9-be24-a08baeda3d76 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:54.262460 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef8808be-ca2f-4672-96e8-9597ac5d4520] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 35638. Aug 18 12:35:54.265410 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.compute.server_external_events [req-13efa2f4-f6a8-4eee-9361-0b3085fc87bf req-803a95f7-2ae8-46c9-be24-a08baeda3d76 service nova] Creating event network-vif-deleted:a1e10ded-ea1a-4c85-af89-4232f64a308a for instance 9bfdb209-645a-4354-b095-977eb38406f5 on hv-cinder-83602 Aug 18 12:35:54.270228 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [req-13efa2f4-f6a8-4eee-9361-0b3085fc87bf req-803a95f7-2ae8-46c9-be24-a08baeda3d76 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039046 Aug 18 12:35:54.270810 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 550/1110] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:35:54.441347 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-37a6e2fa-1444-4da9-9fc9-b5c9c2bbbec5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:54.441347 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-37a6e2fa-1444-4da9-9fc9-b5c9c2bbbec5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:54.442567 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37a6e2fa-1444-4da9-9fc9-b5c9c2bbbec5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:54.443059 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37a6e2fa-1444-4da9-9fc9-b5c9c2bbbec5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:54.443516 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37a6e2fa-1444-4da9-9fc9-b5c9c2bbbec5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:54.444225 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37a6e2fa-1444-4da9-9fc9-b5c9c2bbbec5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:54.444672 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37a6e2fa-1444-4da9-9fc9-b5c9c2bbbec5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:54.445093 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-37a6e2fa-1444-4da9-9fc9-b5c9c2bbbec5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:54.516856 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-37a6e2fa-1444-4da9-9fc9-b5c9c2bbbec5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:54.525585 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-37a6e2fa-1444-4da9-9fc9-b5c9c2bbbec5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1225 microversion: 2.1 time: 0.094404 Aug 18 12:35:54.526272 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 561/1111] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:54 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:35:55.547408 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:55.548050 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:55.554241 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:55.556275 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:55.556275 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:55.556968 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:55.556968 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:55.557299 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:55.588421 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:55.588903 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:55.589405 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:55.589844 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.objects.instance [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lazy-loading 'fault' on Instance uuid 9bfdb209-645a-4354-b095-977eb38406f5 {{(pid=121244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:35:55.631118 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:55.638671 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-c2a808dc-6314-4057-bb66-b70f408b686e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 200 len: 1184 microversion: 2.1 time: 0.096078 Aug 18 12:35:55.639230 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 551/1112] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:55 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 1184 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:35:56.666661 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:56.667258 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 9bfdb209-645a-4354-b095-977eb38406f5] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:56.674141 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:56.674642 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:56.675115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:56.675824 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:56.676277 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:56.676711 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:56.691038 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] HTTP exception thrown: Instance 9bfdb209-645a-4354-b095-977eb38406f5 could not be found. Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Request method failure captured: Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 HTTP/1.1 Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jB5ivz6GwSMa00-FhhKDStZkfuCLiurvTueLGpHGVWjfMc2uAVtKugOj_dU6xg-nsCF6t5KxzFgbf8K_lOzYQ1y3ywSViTWb6GZEBOoB0D31GOPG4Gm9_ePPgGQIHhRuH1eBrDils2b39-okZoDCLrWwXbFx7vEoyJ81HMi2oIynSM Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: c1534d6a880c4f44b741ff5b208663bc Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-TestVolumeBootPattern-323659931 Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:35:56.692797 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-TestVolumeBootPattern-323659931 Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: c1534d6a880c4f44b741ff5b208663bc Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-TestVolumeBootPattern-323659931 Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-TestVolumeBootPattern-323659931-project Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 3907830851364a73b4d3715280a132bc Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-TestVolumeBootPattern-323659931-project Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 9bfdb209-645a-4354-b095-977eb38406f5 could not be found. Aug 18 12:35:56.694410 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '9bfdb209-645a-4354-b095-977eb38406f5'} Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bfdb209-645a-4354-b095-977eb38406f5 could not be found. Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:35:56.695879 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bfdb209-645a-4354-b095-977eb38406f5 could not be found. Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bfdb209-645a-4354-b095-977eb38406f5 could not be found. Aug 18 12:35:56.698353 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:35:56.700325 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Returning 404 to user: Instance 9bfdb209-645a-4354-b095-977eb38406f5 could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:35:56.700325 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-6b9254bb-1739-4db1-a03e-5199abcb27d0 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5" status: 404 len: 111 microversion: 2.1 time: 0.031451 Aug 18 12:35:56.700325 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 562/1113] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:56 2022] GET /compute/v2.1/servers/9bfdb209-645a-4354-b095-977eb38406f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:36:00.301899 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-751568a6-924c-4795-a048-340653cfecca tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:00.302488 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-751568a6-924c-4795-a048-340653cfecca tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:00.304606 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-181dafae-c821-4a7b-805b-1ee55b929fe5 req-3ed941f0-2c3b-4e18-b3f6-03a541d70c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4dd9b1-2d50-4008-9a96-c7cd11cea37c", "tag": "0ab0be7e-e022-4bcb-88d5-2fd5d954c6cd"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:36:00.310482 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-751568a6-924c-4795-a048-340653cfecca tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:00.311102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-751568a6-924c-4795-a048-340653cfecca tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:00.311855 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-751568a6-924c-4795-a048-340653cfecca tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:00.312673 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-751568a6-924c-4795-a048-340653cfecca tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:00.313412 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-751568a6-924c-4795-a048-340653cfecca tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:00.313916 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-751568a6-924c-4795-a048-340653cfecca tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:00.315875 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-181dafae-c821-4a7b-805b-1ee55b929fe5 req-3ed941f0-2c3b-4e18-b3f6-03a541d70c5a service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:00.316597 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-181dafae-c821-4a7b-805b-1ee55b929fe5 req-3ed941f0-2c3b-4e18-b3f6-03a541d70c5a service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:00.317209 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-181dafae-c821-4a7b-805b-1ee55b929fe5 req-3ed941f0-2c3b-4e18-b3f6-03a541d70c5a service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:00.329554 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-181dafae-c821-4a7b-805b-1ee55b929fe5 req-3ed941f0-2c3b-4e18-b3f6-03a541d70c5a service nova] Creating event network-changed:0ab0be7e-e022-4bcb-88d5-2fd5d954c6cd for instance 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c on hv-cinder-83602 Aug 18 12:36:00.335008 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-181dafae-c821-4a7b-805b-1ee55b929fe5 req-3ed941f0-2c3b-4e18-b3f6-03a541d70c5a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034045 Aug 18 12:36:00.336422 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 563/1114] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:00.344595 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-751568a6-924c-4795-a048-340653cfecca tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Going to try to terminate instance {{(pid=121244) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:36:00.593370 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-751568a6-924c-4795-a048-340653cfecca tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "DELETE /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 204 len: 0 microversion: 2.1 time: 0.295404 Aug 18 12:36:00.594334 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 552/1115] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:36:00 2022] DELETE /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:36:00.602960 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-1905a51c-3464-44f6-a1a0-d07210d9f2b2 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:00.603690 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-1905a51c-3464-44f6-a1a0-d07210d9f2b2 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:00.609982 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1905a51c-3464-44f6-a1a0-d07210d9f2b2 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:00.610589 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1905a51c-3464-44f6-a1a0-d07210d9f2b2 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:00.611019 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1905a51c-3464-44f6-a1a0-d07210d9f2b2 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:00.611743 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1905a51c-3464-44f6-a1a0-d07210d9f2b2 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:00.612191 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1905a51c-3464-44f6-a1a0-d07210d9f2b2 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:00.612649 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-1905a51c-3464-44f6-a1a0-d07210d9f2b2 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:00.756535 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.policy [None req-1905a51c-3464-44f6-a1a0-d07210d9f2b2 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121245) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:00.765531 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-1905a51c-3464-44f6-a1a0-d07210d9f2b2 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1578 microversion: 2.1 time: 0.166833 Aug 18 12:36:00.766105 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 564/1116] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:00 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:36:01.787382 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-ce91eb0c-f2b3-49d1-9a72-b828447040b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:01.788102 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-ce91eb0c-f2b3-49d1-9a72-b828447040b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:01.795564 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ce91eb0c-f2b3-49d1-9a72-b828447040b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:01.800404 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ce91eb0c-f2b3-49d1-9a72-b828447040b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:01.800404 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ce91eb0c-f2b3-49d1-9a72-b828447040b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:01.800404 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ce91eb0c-f2b3-49d1-9a72-b828447040b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:01.800404 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ce91eb0c-f2b3-49d1-9a72-b828447040b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:01.800815 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-ce91eb0c-f2b3-49d1-9a72-b828447040b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:01.958385 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-ce91eb0c-f2b3-49d1-9a72-b828447040b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:01.966836 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-ce91eb0c-f2b3-49d1-9a72-b828447040b5 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1578 microversion: 2.1 time: 0.183759 Aug 18 12:36:01.967408 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 553/1117] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:01 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:36:02.543276 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [req-4042cdb0-288a-4f19-941b-c1200b4f35f6 req-53982468-fe87-47e7-851d-93929a5fb292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4dd9b1-2d50-4008-9a96-c7cd11cea37c", "name": "network-vif-deleted", "tag": "0ab0be7e-e022-4bcb-88d5-2fd5d954c6cd"}]} {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:36:02.553161 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-4042cdb0-288a-4f19-941b-c1200b4f35f6 req-53982468-fe87-47e7-851d-93929a5fb292 service nova] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:02.559157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-4042cdb0-288a-4f19-941b-c1200b4f35f6 req-53982468-fe87-47e7-851d-93929a5fb292 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:02.559157 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [req-4042cdb0-288a-4f19-941b-c1200b4f35f6 req-53982468-fe87-47e7-851d-93929a5fb292 service nova] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:02.565128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.compute.server_external_events [req-4042cdb0-288a-4f19-941b-c1200b4f35f6 req-53982468-fe87-47e7-851d-93929a5fb292 service nova] Creating event network-vif-deleted:0ab0be7e-e022-4bcb-88d5-2fd5d954c6cd for instance 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c on hv-cinder-83602 Aug 18 12:36:02.570038 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [req-4042cdb0-288a-4f19-941b-c1200b4f35f6 req-53982468-fe87-47e7-851d-93929a5fb292 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031051 Aug 18 12:36:02.570800 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 565/1118] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Aug 18 12:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:36:02.988220 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-e95c0509-29b9-4b6d-aac1-ae94d39bbd11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:02.989074 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-e95c0509-29b9-4b6d-aac1-ae94d39bbd11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:02.995819 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e95c0509-29b9-4b6d-aac1-ae94d39bbd11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:02.996305 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e95c0509-29b9-4b6d-aac1-ae94d39bbd11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:02.996742 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e95c0509-29b9-4b6d-aac1-ae94d39bbd11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:02.997444 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e95c0509-29b9-4b6d-aac1-ae94d39bbd11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:02.997930 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e95c0509-29b9-4b6d-aac1-ae94d39bbd11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:02.998356 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-e95c0509-29b9-4b6d-aac1-ae94d39bbd11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:03.065404 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.policy [None req-e95c0509-29b9-4b6d-aac1-ae94d39bbd11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3907830851364a73b4d3715280a132bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1534d6a880c4f44b741ff5b208663bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121244) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:03.075288 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-e95c0509-29b9-4b6d-aac1-ae94d39bbd11 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 200 len: 1224 microversion: 2.1 time: 0.089489 Aug 18 12:36:03.075288 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 554/1119] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:02 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:36:04.095480 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:04.096191 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:04.102892 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:04.103515 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:04.103979 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:04.104669 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:04.105122 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:04.105545 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:04.119607 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] HTTP exception thrown: Instance 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c could not be found. Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Request method failure captured: Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c HTTP/1.1 Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jB5ivz6GwSMa00-FhhKDStZkfuCLiurvTueLGpHGVWjfMc2uAVtKugOj_dU6xg-nsCF6t5KxzFgbf8K_lOzYQ1y3ywSViTWb6GZEBOoB0D31GOPG4Gm9_ePPgGQIHhRuH1eBrDils2b39-okZoDCLrWwXbFx7vEoyJ81HMi2oIynSM Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: c1534d6a880c4f44b741ff5b208663bc Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-TestVolumeBootPattern-323659931 Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:36:04.121219 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-TestVolumeBootPattern-323659931 Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: c1534d6a880c4f44b741ff5b208663bc Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-TestVolumeBootPattern-323659931 Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-TestVolumeBootPattern-323659931-project Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 3907830851364a73b4d3715280a132bc Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-TestVolumeBootPattern-323659931-project Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c could not be found. Aug 18 12:36:04.122938 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '1b4dd9b1-2d50-4008-9a96-c7cd11cea37c'} Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c could not be found. Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:36:04.123958 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c could not be found. Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c could not be found. Aug 18 12:36:04.125566 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.127128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Returning 404 to user: Instance 1b4dd9b1-2d50-4008-9a96-c7cd11cea37c could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:36:04.127128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-9f613c31-f129-48df-8722-d0595ffdef83 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c" status: 404 len: 111 microversion: 2.1 time: 0.031934 Aug 18 12:36:04.127128 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 566/1120] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:04 2022] GET /compute/v2.1/servers/1b4dd9b1-2d50-4008-9a96-c7cd11cea37c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:36:04.635840 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:04.636401 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.compute.api [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121244) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:04.642689 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:04.643176 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:04.643654 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:04.644354 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:04.644811 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:04.645236 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG oslo_concurrency.lockutils [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:04.658542 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.wsgi [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] HTTP exception thrown: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Request method failure captured: Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: request: DELETE /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d HTTP/1.1 Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept: application/json Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Accept-Encoding: identity Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Connection: close Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Length: 0 Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Content-Type: application/json Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Host: 10.222.0.98 Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Openstack-System-Scope: None Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: User-Agent: python-urllib3/1.26.11 Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Auth-Token: gAAAAABi_jB5ivz6GwSMa00-FhhKDStZkfuCLiurvTueLGpHGVWjfMc2uAVtKugOj_dU6xg-nsCF6t5KxzFgbf8K_lOzYQ1y3ywSViTWb6GZEBOoB0D31GOPG4Gm9_ePPgGQIHhRuH1eBrDils2b39-okZoDCLrWwXbFx7vEoyJ81HMi2oIynSM Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Id: None Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Domain-Name: None Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Identity-Status: Confirmed Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Is-Admin-Project: True Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Id: default Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Domain-Name: Default Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Id: c1534d6a880c4f44b741ff5b208663bc Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Project-Name: tempest-TestVolumeBootPattern-323659931 Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Role: member,reader Aug 18 12:36:04.660225 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Roles: member,reader Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant: tempest-TestVolumeBootPattern-323659931 Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Id: c1534d6a880c4f44b741ff5b208663bc Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-Tenant-Name: tempest-TestVolumeBootPattern-323659931 Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User: tempest-TestVolumeBootPattern-323659931-project Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Id: default Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Domain-Name: Default Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Id: 3907830851364a73b4d3715280a132bc Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: X-User-Name: tempest-TestVolumeBootPattern-323659931-project Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: method: > Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: exception: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:36:04.661941 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: action_args: {'id': '3b3d0863-3d23-4709-83a9-12686e8b3e7d'} Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:36:04.663126 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:36:04.664764 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.667157 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Returning 404 to user: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. {{(pid=121244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:36:04.667157 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-877f299c-9888-43d8-a910-f00bbc08e8bd tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 404 len: 111 microversion: 2.1 time: 0.029639 Aug 18 12:36:04.667157 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 555/1121] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Aug 18 12:36:04 2022] DELETE /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:36:04.670543 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '>' {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:04.671165 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.compute.api [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] [instance: 3b3d0863-3d23-4709-83a9-12686e8b3e7d] Fetching instance by UUID {{(pid=121245) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:04.677111 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:04.677589 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:04.678030 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:04.678723 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Acquiring lock "aac207c6-8c23-44cd-8489-7302b48d46d6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:04.679176 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:04.679639 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG oslo_concurrency.lockutils [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Lock "aac207c6-8c23-44cd-8489-7302b48d46d6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:04.693737 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.wsgi [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] HTTP exception thrown: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Request method failure captured: Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: request: GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d HTTP/1.1 Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept: application/json Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Accept-Encoding: identity Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Connection: close Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Length: 0 Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Content-Type: application/json Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Host: 10.222.0.98 Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Openstack-System-Scope: None Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: User-Agent: python-urllib3/1.26.11 Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Auth-Token: gAAAAABi_jB5ivz6GwSMa00-FhhKDStZkfuCLiurvTueLGpHGVWjfMc2uAVtKugOj_dU6xg-nsCF6t5KxzFgbf8K_lOzYQ1y3ywSViTWb6GZEBOoB0D31GOPG4Gm9_ePPgGQIHhRuH1eBrDils2b39-okZoDCLrWwXbFx7vEoyJ81HMi2oIynSM Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Id: None Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Domain-Name: None Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Identity-Status: Confirmed Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Is-Admin-Project: True Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Id: default Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Domain-Name: Default Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Id: c1534d6a880c4f44b741ff5b208663bc Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Project-Name: tempest-TestVolumeBootPattern-323659931 Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Role: member,reader Aug 18 12:36:04.695739 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Roles: member,reader Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c1534d6a880c4f44b741ff5b208663bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}] Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant: tempest-TestVolumeBootPattern-323659931 Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Id: c1534d6a880c4f44b741ff5b208663bc Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-Tenant-Name: tempest-TestVolumeBootPattern-323659931 Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User: tempest-TestVolumeBootPattern-323659931-project Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Id: default Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Domain-Name: Default Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Id: 3907830851364a73b4d3715280a132bc Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: X-User-Name: tempest-TestVolumeBootPattern-323659931-project Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: method: > Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: exception: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:36:04.698115 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: action_args: {'id': '3b3d0863-3d23-4709-83a9-12686e8b3e7d'} Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: {{(pid=121245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:36:04.699143 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. Aug 18 12:36:04.702160 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: ERROR nova.api.openstack.wsgi Aug 18 12:36:04.703821 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: DEBUG nova.api.openstack.wsgi [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Returning 404 to user: Instance 3b3d0863-3d23-4709-83a9-12686e8b3e7d could not be found. {{(pid=121245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:36:04.703821 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO nova.api.openstack.requestlog [None req-0065065c-f000-47ea-980f-d72fb5513be6 tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d" status: 404 len: 111 microversion: 2.1 time: 0.030048 Aug 18 12:36:04.703821 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: [pid: 121245|app: 0|req: 567/1122] 10.222.0.98 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:04 2022] GET /compute/v2.1/servers/3b3d0863-3d23-4709-83a9-12686e8b3e7d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:36:06.231161 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: DEBUG nova.api.openstack.wsgi [None req-df5f60e0-22d7-47a4-bbb1-9006c827c80e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] Calling method '.version_select at 0x7f3794a0dc10>' {{(pid=121244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:06.319172 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO nova.api.openstack.requestlog [None req-df5f60e0-22d7-47a4-bbb1-9006c827c80e tempest-TestVolumeBootPattern-323659931 tempest-TestVolumeBootPattern-323659931-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-229203386" status: 202 len: 0 microversion: 2.1 time: 0.091900 Aug 18 12:36:06.319777 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: [pid: 121244|app: 0|req: 556/1123] 10.222.0.98 () {58 vars in 1260 bytes} [Thu Aug 18 12:36:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-229203386 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:38:52.155583 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:38:52.156437 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Thu Aug 18 12:38:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:38:52.201492 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:38:52.202069 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Thu Aug 18 12:38:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:38:55.497194 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:38:55.497756 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Thu Aug 18 12:38:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:38:56.726058 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:38:56.726627 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Thu Aug 18 12:38:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:39:13.163127 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:39:13.163766 dv-cinder-836027-7-iscsi devstack@n-api.service[121244]: Thu Aug 18 12:39:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:39:14.399846 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:39:14.400496 dv-cinder-836027-7-iscsi devstack@n-api.service[121245]: Thu Aug 18 12:39:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!